[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:46:24 dist-test-slave-45dx krb5kdc[13111](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:46:24 dist-test-slave-45dx krb5kdc[13111](info): set up 2 sockets
Aug 09 18:46:24 dist-test-slave-45dx krb5kdc[13111](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 18:46:26.002063 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.304s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:46:26 dist-test-slave-45dx krb5kdc[13111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301186, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:46:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:46:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:46:26.124094 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:42127
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:42599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:42127
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:26.223212 13133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:26.223521 13133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:26.223573 13133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:26.225195 13133 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:46:26.225278 13133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:26.225310 13133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:26.225338 13133 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:46:26.225392 13133 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:46:26.227353 13133 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:42599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:42127
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:42127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:26.227701 13133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:26.227991 13133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:26.233783 13145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:26.233870 13141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:26.233769 13140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:26.234366 13133 server_base.cc:1034] running on GCE node
I20260809 18:46:26.234637 13133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:26.234941 13133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:26.236114 13133 hybrid_clock.cc:648] HybridClock initialized: now 1786301186236104 us; error 51 us; skew 500 ppm
Aug 09 18:46:26 dist-test-slave-45dx krb5kdc[13111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301186, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:26.249548 13133 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:46:26.250087 13133 webserver.cc:460] Webserver started at http://127.12.202.254:37989/ using document root <none> and password file <none>
I20260809 18:46:26.250370 13133 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:26.250422 13133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:26.250597 13133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:26.252038 13133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "2ccf25cd99b74c118005dc42d79191ca"
format_stamp: "Formatted at 2026-08-09 18:46:26 on dist-test-slave-45dx"
server_key: "a993dc333a09219f9a8f6d69c25890dc"
server_key_iv: "6c3d89f03dcd1937e62ac62aff237177"
server_key_version: "encryptionkey@0"
I20260809 18:46:26.252502 13133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "2ccf25cd99b74c118005dc42d79191ca"
format_stamp: "Formatted at 2026-08-09 18:46:26 on dist-test-slave-45dx"
server_key: "a993dc333a09219f9a8f6d69c25890dc"
server_key_iv: "6c3d89f03dcd1937e62ac62aff237177"
server_key_version: "encryptionkey@0"
I20260809 18:46:26.254148 13133 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:46:26.255125 13156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:26.255405 13133 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:46:26.255520 13133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "2ccf25cd99b74c118005dc42d79191ca"
format_stamp: "Formatted at 2026-08-09 18:46:26 on dist-test-slave-45dx"
server_key: "a993dc333a09219f9a8f6d69c25890dc"
server_key_iv: "6c3d89f03dcd1937e62ac62aff237177"
server_key_version: "encryptionkey@0"
I20260809 18:46:26.255601 13133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:26.278978 13133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:26.281714 13133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:26.281857 13133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:26.292268 13133 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:42127
I20260809 18:46:26.292346 13239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:42127 every 8 connection(s)
I20260809 18:46:26.292749 13133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:46:26.293893 13240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:26.296991 13240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca: Bootstrap starting.
I20260809 18:46:26.297793 13240 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:26.298121 13240 log.cc:824] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:26.299012 13240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca: No bootstrap required, opened a new log
I20260809 18:46:26.300071 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 13133
I20260809 18:46:26.300195 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:46:26.301116 13099 external_mini_cluster.cc:1428] Setting key 83b9f61910230bb5b0a54743e872baf6
I20260809 18:46:26.301690 13240 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccf25cd99b74c118005dc42d79191ca" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42127 } }
I20260809 18:46:26.301900 13240 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:26.301954 13240 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ccf25cd99b74c118005dc42d79191ca, State: Initialized, Role: FOLLOWER
I20260809 18:46:26.302106 13240 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccf25cd99b74c118005dc42d79191ca" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42127 } }
I20260809 18:46:26.302212 13240 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:46:26.302273 13240 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:46:26.302362 13240 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:26.303387 13240 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccf25cd99b74c118005dc42d79191ca" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42127 } }
I20260809 18:46:26.303480 13240 leader_election.cc:302] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ccf25cd99b74c118005dc42d79191ca; no voters:
I20260809 18:46:26.303676 13240 leader_election.cc:288] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:46:26.303694 13246 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:26.303824 13246 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca [term 1 LEADER]: Becoming Leader. State: Replica: 2ccf25cd99b74c118005dc42d79191ca, State: Running, Role: LEADER
I20260809 18:46:26.303961 13240 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:26.303975 13246 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccf25cd99b74c118005dc42d79191ca" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42127 } }
I20260809 18:46:26.304586 13249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ccf25cd99b74c118005dc42d79191ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccf25cd99b74c118005dc42d79191ca" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42127 } } }
I20260809 18:46:26.304684 13249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:26.304872 13248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ccf25cd99b74c118005dc42d79191ca. Latest consensus state: current_term: 1 leader_uuid: "2ccf25cd99b74c118005dc42d79191ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccf25cd99b74c118005dc42d79191ca" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42127 } } }
I20260809 18:46:26.304939 13248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:26.305377 13257 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:46:26.306218 13257 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:46:26.307964 13257 catalog_manager.cc:1347] Generated new cluster ID: 33811cfe3345475583437afef36bf3bc
I20260809 18:46:26.308017 13257 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:46:26 dist-test-slave-45dx krb5kdc[13111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301186, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:26.321538 13245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:26.302207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36532 (local address 127.12.202.254:42127)
0809 18:46:26.302476 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:26.302487 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:26.302666 (+ 179us) server_negotiation.cc:407] Connection header received
0809 18:46:26.304961 (+ 2295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:26.304969 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:26.305024 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:26.305129 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:26.307745 (+ 2616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:26.309187 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:26.310622 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:26.311214 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:26.311309 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:26.316595 (+ 5286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:26.316600 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:26.316600 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:26.316614 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:26.318813 (+ 2199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:26.319305 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:26.319308 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:26.319309 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:26.319447 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:26.319744 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:26.319745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:26.319745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:26.320027 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:26.320227 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:26.320968 (+ 741us) server_negotiation.cc:299] Negotiation successful
0809 18:46:26.321156 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":111,"threads_started":1}
I20260809 18:46:26.328133 13257 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:46:26.328685 13257 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:46:26.331185 13257 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ccf25cd99b74c118005dc42d79191ca: Generated new TSK 0
I20260809 18:46:26.331360 13257 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
I20260809 18:46:26.362767 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42127
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:42599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:26.476882 13275 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:26.477120 13275 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:26.477162 13275 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:26.478396 13275 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:26.478461 13275 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:26.478508 13275 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:46:26.480168 13275 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:42599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42127
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13275
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:26.480435 13275 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:26.480680 13275 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:26.486620 13285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:26.486608 13284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:26.486599 13291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:26.486876 13275 server_base.cc:1034] running on GCE node
I20260809 18:46:26.487083 13275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:26.487300 13275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:26.488440 13275 hybrid_clock.cc:648] HybridClock initialized: now 1786301186488429 us; error 33 us; skew 500 ppm
Aug 09 18:46:26 dist-test-slave-45dx krb5kdc[13111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301186, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:26.491526 13275 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:46:26.492041 13275 webserver.cc:460] Webserver started at http://127.12.202.193:44215/ using document root <none> and password file <none>
I20260809 18:46:26.492281 13275 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:26.492378 13275 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:26.492542 13275 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:26.493924 13275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "f42841fa594b4f838289ea89de1e6b0f"
format_stamp: "Formatted at 2026-08-09 18:46:26 on dist-test-slave-45dx"
server_key: "7aec5342e10ccb0809d5f429b8e58894"
server_key_iv: "97779781830de0d3a91000a351f3906b"
server_key_version: "encryptionkey@0"
I20260809 18:46:26.494416 13275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "f42841fa594b4f838289ea89de1e6b0f"
format_stamp: "Formatted at 2026-08-09 18:46:26 on dist-test-slave-45dx"
server_key: "7aec5342e10ccb0809d5f429b8e58894"
server_key_iv: "97779781830de0d3a91000a351f3906b"
server_key_version: "encryptionkey@0"
I20260809 18:46:26.496133 13275 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:46:26.497051 13298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:26.497262 13275 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:26.497400 13275 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "f42841fa594b4f838289ea89de1e6b0f"
format_stamp: "Formatted at 2026-08-09 18:46:26 on dist-test-slave-45dx"
server_key: "7aec5342e10ccb0809d5f429b8e58894"
server_key_iv: "97779781830de0d3a91000a351f3906b"
server_key_version: "encryptionkey@0"
I20260809 18:46:26.497485 13275 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:26.509460 13275 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:26.511519 13275 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:26.511725 13275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:26.512158 13275 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:26.512624 13275 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:26.512686 13275 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:26.512732 13275 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:26.512755 13275 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:26.527930 13275 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:36311
I20260809 18:46:26.528029 13478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:36311 every 8 connection(s)
I20260809 18:46:26.528448 13275 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:46:26.528748 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 13275
I20260809 18:46:26.528890 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:46:26.529086 13099 external_mini_cluster.cc:1428] Setting key 50c67968cb26e12223ffde0392cfa2be
Aug 09 18:46:26 dist-test-slave-45dx krb5kdc[13111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301186, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.202.194@KRBTEST.COM; defaulting to no policy
I20260809 18:46:26.540639 13245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:26.529455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:35937 (local address 127.12.202.254:42127)
0809 18:46:26.529510 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:26.529512 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:26.529955 (+ 443us) server_negotiation.cc:407] Connection header received
0809 18:46:26.530738 (+ 783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:26.530739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:26.530755 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:26.530802 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:26.532013 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:26.532668 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:26.533891 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:26.534191 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:26.534270 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:26.537097 (+ 2827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:26.537099 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:26.537099 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:26.537106 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:26.539039 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:26.539569 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:26.539569 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:26.539570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:26.539624 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:26.539910 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:26.539910 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:26.539910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:26.540013 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:26.540071 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:26.540435 (+ 364us) server_negotiation.cc:299] Negotiation successful
0809 18:46:26.540563 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 18:46:26.540810 13481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:26.529447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42127 (local address 127.12.202.193:35937)
0809 18:46:26.529797 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:26.529843 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:26.530621 (+ 778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:26.530891 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:26.530895 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:26.531612 (+ 717us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:26.531904 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:26.531910 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:26.532769 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:26.532770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:26.533762 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:26.533765 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:26.534279 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:26.534280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:26.534463 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:26.535058 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:26.535066 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:26.536951 (+ 1885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:26.539127 (+ 2176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:26.539135 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:26.539137 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:26.539494 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:26.539699 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:26.539700 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:26.539701 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:26.539849 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:26.540080 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:26.540084 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:26.540199 (+ 115us) client_negotiation.cc:769] Sending connection context
0809 18:46:26.540282 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 18:46:26.540499 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":214,"threads_started":1}
I20260809 18:46:26.541420 13479 heartbeater.cc:347] Connected to a master server at 127.12.202.254:42127
I20260809 18:46:26.541510 13479 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:26.541692 13479 heartbeater.cc:511] Master 127.12.202.254:42127 requested a full tablet report, sending...
I20260809 18:46:26.542286 13181 ts_manager.cc:194] Registered new tserver with Master: f42841fa594b4f838289ea89de1e6b0f (127.12.202.193:36311)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.194@KRBTEST.COM" created.
I20260809 18:46:26.543027 13181 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:35937
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
I20260809 18:46:26.559667 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42127
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:42599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:26.660941 13484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:26.661188 13484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:26.661232 13484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:26.662431 13484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:26.662503 13484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:26.662550 13484 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:46:26.664146 13484 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:42599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42127
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:26.664441 13484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:26.664713 13484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:26.670467 13495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:26.670509 13491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:26.670665 13499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:26.670925 13484 server_base.cc:1034] running on GCE node
I20260809 18:46:26.671145 13484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:26.671408 13484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:26.672561 13484 hybrid_clock.cc:648] HybridClock initialized: now 1786301186672541 us; error 43 us; skew 500 ppm
Aug 09 18:46:26 dist-test-slave-45dx krb5kdc[13111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301186, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:26.675756 13484 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:46:26.676255 13484 webserver.cc:460] Webserver started at http://127.12.202.194:44581/ using document root <none> and password file <none>
I20260809 18:46:26.676539 13484 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:26.676613 13484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:26.676775 13484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:26.678045 13484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "354f33354bb74f32986fd62597a4f0b2"
format_stamp: "Formatted at 2026-08-09 18:46:26 on dist-test-slave-45dx"
server_key: "24a8ab9df5b8f65a9d8f816645c77b33"
server_key_iv: "5428e76997421c29066ca9dee64b10a6"
server_key_version: "encryptionkey@0"
I20260809 18:46:26.678494 13484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "354f33354bb74f32986fd62597a4f0b2"
format_stamp: "Formatted at 2026-08-09 18:46:26 on dist-test-slave-45dx"
server_key: "24a8ab9df5b8f65a9d8f816645c77b33"
server_key_iv: "5428e76997421c29066ca9dee64b10a6"
server_key_version: "encryptionkey@0"
I20260809 18:46:26.680119 13484 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:46:26.681048 13509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:26.681236 13484 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:46:26.681352 13484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "354f33354bb74f32986fd62597a4f0b2"
format_stamp: "Formatted at 2026-08-09 18:46:26 on dist-test-slave-45dx"
server_key: "24a8ab9df5b8f65a9d8f816645c77b33"
server_key_iv: "5428e76997421c29066ca9dee64b10a6"
server_key_version: "encryptionkey@0"
I20260809 18:46:26.681432 13484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:26.696614 13484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:26.698988 13484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:26.699205 13484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:26.699529 13484 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:26.699926 13484 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:26.699986 13484 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:26.700023 13484 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:26.700073 13484 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:26.713125 13484 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:45201
I20260809 18:46:26.713181 13687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:45201 every 8 connection(s)
I20260809 18:46:26.713558 13484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:46:26.715683 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 13484
I20260809 18:46:26.715797 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:46:26.715996 13099 external_mini_cluster.cc:1428] Setting key 0e8281b7df92dc70b7a5ab4c6fed5119
Aug 09 18:46:26 dist-test-slave-45dx krb5kdc[13111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301186, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:26.724987 13245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:26.714495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:46521 (local address 127.12.202.254:42127)
0809 18:46:26.714569 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:26.714571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:26.714870 (+ 299us) server_negotiation.cc:407] Connection header received
0809 18:46:26.715347 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:26.715348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:26.715358 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:26.715420 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:26.716600 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:26.717104 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:26.718296 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:26.718496 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:26.718586 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:26.721710 (+ 3124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:26.721711 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:26.721712 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:26.721718 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:26.723255 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:26.723874 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:26.723875 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:26.723876 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:26.723935 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:26.724232 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:26.724232 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:26.724232 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:26.724416 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:26.724473 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:26.724839 (+ 366us) server_negotiation.cc:299] Negotiation successful
0809 18:46:26.724916 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 18:46:26.725297 13693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:26.714479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42127 (local address 127.12.202.194:46521)
0809 18:46:26.714710 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:26.714757 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:26.715262 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:26.715503 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:26.715506 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:26.716211 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:26.716491 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:26.716496 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:26.717203 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:26.717204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:26.718167 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:26.718169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:26.718599 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:26.718600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:26.718788 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:26.719489 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:26.719498 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:26.721601 (+ 2103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:26.723359 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:26.723368 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:26.723370 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:26.723762 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:26.724012 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:26.724013 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:26.724013 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:26.724163 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:26.724486 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:26.724494 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:26.724673 (+ 179us) client_negotiation.cc:769] Sending connection context
0809 18:46:26.724820 (+ 147us) client_negotiation.cc:240] Negotiation successful
0809 18:46:26.725015 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":132,"threads_started":1}
I20260809 18:46:26.725955 13690 heartbeater.cc:347] Connected to a master server at 127.12.202.254:42127
I20260809 18:46:26.726050 13690 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:26.726269 13690 heartbeater.cc:511] Master 127.12.202.254:42127 requested a full tablet report, sending...
I20260809 18:46:26.726730 13181 ts_manager.cc:194] Registered new tserver with Master: 354f33354bb74f32986fd62597a4f0b2 (127.12.202.194:45201)
WARNING: no policy specified for kudu/127.12.202.195@KRBTEST.COM; defaulting to no policy
I20260809 18:46:26.727130 13181 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:46521
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
I20260809 18:46:26.747700 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42127
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:42599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:26.839977 13696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:26.840181 13696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:26.840206 13696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:26.841418 13696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:26.841461 13696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:26.841513 13696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:46:26.842967 13696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:42599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42127
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:26.843211 13696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:26.843441 13696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:26.848568 13709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:26.848625 13704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:26.848641 13705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:26.848902 13696 server_base.cc:1034] running on GCE node
I20260809 18:46:26.849079 13696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:26.849272 13696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:26.850481 13696 hybrid_clock.cc:648] HybridClock initialized: now 1786301186850468 us; error 30 us; skew 500 ppm
Aug 09 18:46:26 dist-test-slave-45dx krb5kdc[13111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301186, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:26.853066 13696 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:46:26.853508 13696 webserver.cc:460] Webserver started at http://127.12.202.195:42807/ using document root <none> and password file <none>
I20260809 18:46:26.853740 13696 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:26.853818 13696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:26.853973 13696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:26.855036 13696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "b37753442d77433ab6eb08b2588ad33e"
format_stamp: "Formatted at 2026-08-09 18:46:26 on dist-test-slave-45dx"
server_key: "56fbda7c88926ad426fb9ecadda50b04"
server_key_iv: "7f1dec0e3d2eea4594b4a5139bde0bef"
server_key_version: "encryptionkey@0"
I20260809 18:46:26.855413 13696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "b37753442d77433ab6eb08b2588ad33e"
format_stamp: "Formatted at 2026-08-09 18:46:26 on dist-test-slave-45dx"
server_key: "56fbda7c88926ad426fb9ecadda50b04"
server_key_iv: "7f1dec0e3d2eea4594b4a5139bde0bef"
server_key_version: "encryptionkey@0"
I20260809 18:46:26.856969 13696 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:46:26.857815 13718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:26.858035 13696 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:26.858155 13696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "b37753442d77433ab6eb08b2588ad33e"
format_stamp: "Formatted at 2026-08-09 18:46:26 on dist-test-slave-45dx"
server_key: "56fbda7c88926ad426fb9ecadda50b04"
server_key_iv: "7f1dec0e3d2eea4594b4a5139bde0bef"
server_key_version: "encryptionkey@0"
I20260809 18:46:26.858234 13696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:26.885413 13696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:26.887452 13696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:26.887645 13696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:26.887933 13696 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:26.888267 13696 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:26.888351 13696 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:26.888415 13696 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:26.888448 13696 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:26.894703 13696 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:40281
I20260809 18:46:26.894757 13906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:40281 every 8 connection(s)
I20260809 18:46:26.895089 13696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:46:26 dist-test-slave-45dx krb5kdc[13111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301186, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:26.903620 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 13696
I20260809 18:46:26.903738 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:46:26.903936 13099 external_mini_cluster.cc:1428] Setting key 7cd1f056a2b840fe0cd1b4e0f78f212e
I20260809 18:46:26.905650 13245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:26.895980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:53211 (local address 127.12.202.254:42127)
0809 18:46:26.896070 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:26.896072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:26.896245 (+ 173us) server_negotiation.cc:407] Connection header received
0809 18:46:26.896826 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:26.896827 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:26.896853 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:26.896919 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:26.897886 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:26.898436 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:26.899406 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:26.899591 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:26.899648 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:26.902117 (+ 2469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:26.902118 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:26.902118 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:26.902125 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:26.903621 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:26.904348 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:26.904349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:26.904349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:26.904435 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:26.904727 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:26.904728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:26.904728 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:26.904894 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:26.905018 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:26.905515 (+ 497us) server_negotiation.cc:299] Negotiation successful
0809 18:46:26.905585 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 18:46:26.905872 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:26.895943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42127 (local address 127.12.202.195:53211)
0809 18:46:26.896105 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:26.896150 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:26.896725 (+ 575us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:26.897003 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:26.897006 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:26.897589 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:26.897782 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:26.897787 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:26.898519 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:26.898520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:26.899321 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:26.899324 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:26.899670 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:26.899671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:26.899775 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:26.900363 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:26.900373 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:26.902012 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:26.903758 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:26.903766 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:26.903769 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:26.904209 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:26.904493 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:26.904494 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:26.904495 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:26.904652 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:26.905149 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:26.905156 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:26.905363 (+ 207us) client_negotiation.cc:769] Sending connection context
0809 18:46:26.905486 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 18:46:26.905637 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":93,"threads_started":1}
I20260809 18:46:26.906344 13907 heartbeater.cc:347] Connected to a master server at 127.12.202.254:42127
I20260809 18:46:26.906446 13907 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:26.906595 13907 heartbeater.cc:511] Master 127.12.202.254:42127 requested a full tablet report, sending...
I20260809 18:46:26.906936 13181 ts_manager.cc:194] Registered new tserver with Master: b37753442d77433ab6eb08b2588ad33e (127.12.202.195:40281)
I20260809 18:46:26.907327 13181 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:53211
I20260809 18:46:26.916558 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 18:46:26 dist-test-slave-45dx krb5kdc[13111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301186, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 18:46:26 dist-test-slave-45dx krb5kdc[13111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301186, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.202.193@KRBTEST.COM
I20260809 18:46:26.942976 13917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:26.934379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33704 (local address 127.12.202.193:36311)
0809 18:46:26.934609 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:26.934614 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:26.934625 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:46:26.934653 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:26.934655 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:26.934671 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:26.934744 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:26.935291 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:26.936618 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:26.937337 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:26.937657 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:26.937714 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:26.940154 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:26.940163 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:26.940163 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:26.940170 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:26.941807 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:26.942134 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:26.942136 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:26.942137 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:26.942201 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:26.942382 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:26.942383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:26.942383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:26.942524 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:26.942649 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:26.942688 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 18:46:26.942783 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":140,"threads_started":1}
W20260809 18:46:26.943526 13346 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33704
Aug 09 18:46:26 dist-test-slave-45dx krb5kdc[13111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301186, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 18:46:26 dist-test-slave-45dx krb5kdc[13111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301186, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.193@KRBTEST.COM
I20260809 18:46:26.968146 13917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:26.961215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33710 (local address 127.12.202.193:36311)
0809 18:46:26.961294 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:26.961296 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:26.961324 (+ 28us) server_negotiation.cc:407] Connection header received
0809 18:46:26.961415 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:26.961416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:26.961431 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:26.961487 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:26.962151 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:26.962644 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:26.963334 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:26.963530 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:26.963587 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:26.965885 (+ 2298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:26.965887 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:26.965887 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:26.965895 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:26.967180 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:26.967496 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:26.967497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:26.967497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:26.967550 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:26.967717 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:26.967718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:26.967718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:26.967820 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:26.967914 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:26.967979 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 18:46:26.968042 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 18:46:26.968752 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 13275
I20260809 18:46:26.989400 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 13484
I20260809 18:46:26.996975 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 13696
I20260809 18:46:27.005774 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 13133
2026-08-09T18:46:27Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2342 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:46:27 dist-test-slave-45dx krb5kdc[13926](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:46:27 dist-test-slave-45dx krb5kdc[13926](info): set up 2 sockets
Aug 09 18:46:27 dist-test-slave-45dx krb5kdc[13926](info): commencing operation
krb5kdc: starting...
W20260809 18:46:28.390323 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.355s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260809 18:46:28.716051 13099 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.326s user 0.000s sys 0.002s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260809 18:46:28.900501 13099 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.184s user 0.000s sys 0.002s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/test-user.keytab.
W20260809 18:46:29.659472 13099 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.669s user 0.000s sys 0.002s
Aug 09 18:46:29 dist-test-slave-45dx krb5kdc[13926](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301189, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:46:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:46:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:46:29.724205 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:33825
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:37747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:33825
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:29.806490 13945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:29.806748 13945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:29.806797 13945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:29.807960 13945 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:46:29.808032 13945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:29.808056 13945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:29.808079 13945 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:46:29.808107 13945 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:46:29.809615 13945 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:37747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:33825
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:33825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13945
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:29.809908 13945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:29.810148 13945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:29.815233 13963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:29.815384 13945 server_base.cc:1034] running on GCE node
W20260809 18:46:29.815209 13959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:29.815205 13961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:29.815737 13945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:29.816059 13945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:29.817262 13945 hybrid_clock.cc:648] HybridClock initialized: now 1786301189817257 us; error 39 us; skew 500 ppm
Aug 09 18:46:29 dist-test-slave-45dx krb5kdc[13926](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301189, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:29.819972 13945 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:46:29.820528 13945 webserver.cc:460] Webserver started at http://127.12.202.254:41589/ using document root <none> and password file <none>
I20260809 18:46:29.820760 13945 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:29.820832 13945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:29.820986 13945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:29.822183 13945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "545e1ac3b6fe45c1a7c1fec2ab192c27"
format_stamp: "Formatted at 2026-08-09 18:46:29 on dist-test-slave-45dx"
server_key: "12c1a9fbcd99847a11634b6a9990f35d"
server_key_iv: "eb2853932445aef05f818b0b01b5263d"
server_key_version: "encryptionkey@0"
I20260809 18:46:29.822567 13945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "545e1ac3b6fe45c1a7c1fec2ab192c27"
format_stamp: "Formatted at 2026-08-09 18:46:29 on dist-test-slave-45dx"
server_key: "12c1a9fbcd99847a11634b6a9990f35d"
server_key_iv: "eb2853932445aef05f818b0b01b5263d"
server_key_version: "encryptionkey@0"
I20260809 18:46:29.823932 13945 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:46:29.824821 13975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:29.825021 13945 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:46:29.825135 13945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "545e1ac3b6fe45c1a7c1fec2ab192c27"
format_stamp: "Formatted at 2026-08-09 18:46:29 on dist-test-slave-45dx"
server_key: "12c1a9fbcd99847a11634b6a9990f35d"
server_key_iv: "eb2853932445aef05f818b0b01b5263d"
server_key_version: "encryptionkey@0"
I20260809 18:46:29.825214 13945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:29.837322 13945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:29.839650 13945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:29.839816 13945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:29.844080 13945 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:33825
I20260809 18:46:29.844116 14047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:33825 every 8 connection(s)
I20260809 18:46:29.844514 13945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:46:29.845372 14049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:29.847692 14049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27: Bootstrap starting.
I20260809 18:46:29.848242 14049 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:29.848567 14049 log.cc:824] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:29.849223 14049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27: No bootstrap required, opened a new log
I20260809 18:46:29.849589 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 13945
I20260809 18:46:29.849684 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:46:29.849858 13099 external_mini_cluster.cc:1428] Setting key 38eb83d1e7b3ae503b496140b3bad977
I20260809 18:46:29.851349 14049 raft_consensus.cc:348] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "545e1ac3b6fe45c1a7c1fec2ab192c27" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 33825 } }
I20260809 18:46:29.851516 14049 raft_consensus.cc:374] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:29.851553 14049 raft_consensus.cc:729] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 545e1ac3b6fe45c1a7c1fec2ab192c27, State: Initialized, Role: FOLLOWER
I20260809 18:46:29.851725 14049 consensus_queue.cc:260] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "545e1ac3b6fe45c1a7c1fec2ab192c27" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 33825 } }
I20260809 18:46:29.851821 14049 raft_consensus.cc:388] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:46:29.851861 14049 raft_consensus.cc:482] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:46:29.851918 14049 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:29.853046 14049 raft_consensus.cc:504] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "545e1ac3b6fe45c1a7c1fec2ab192c27" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 33825 } }
I20260809 18:46:29.853137 14049 leader_election.cc:302] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 545e1ac3b6fe45c1a7c1fec2ab192c27; no voters:
I20260809 18:46:29.853323 14049 leader_election.cc:288] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:46:29.853386 14059 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:29.853581 14059 raft_consensus.cc:686] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27 [term 1 LEADER]: Becoming Leader. State: Replica: 545e1ac3b6fe45c1a7c1fec2ab192c27, State: Running, Role: LEADER
I20260809 18:46:29.853587 14049 sys_catalog.cc:564] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:29.853696 14059 consensus_queue.cc:237] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "545e1ac3b6fe45c1a7c1fec2ab192c27" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 33825 } }
I20260809 18:46:29.854116 14059 sys_catalog.cc:455] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 545e1ac3b6fe45c1a7c1fec2ab192c27. Latest consensus state: current_term: 1 leader_uuid: "545e1ac3b6fe45c1a7c1fec2ab192c27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "545e1ac3b6fe45c1a7c1fec2ab192c27" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 33825 } } }
I20260809 18:46:29.854250 14059 sys_catalog.cc:458] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27 [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:29.854241 14061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "545e1ac3b6fe45c1a7c1fec2ab192c27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "545e1ac3b6fe45c1a7c1fec2ab192c27" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 33825 } } }
I20260809 18:46:29.854388 14061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27 [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:29.855438 14078 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:46:29.855938 14078 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 18:46:29 dist-test-slave-45dx krb5kdc[13926](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301189, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:29.857705 14078 catalog_manager.cc:1347] Generated new cluster ID: 3ded75609e5f41aeba171ce8b100b958
I20260809 18:46:29.857759 14078 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:46:29.861846 14057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:29.850386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51384 (local address 127.12.202.254:33825)
0809 18:46:29.850582 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:29.850589 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:29.850615 (+ 26us) server_negotiation.cc:407] Connection header received
0809 18:46:29.851334 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:29.851340 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:29.851390 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:29.851501 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:29.852335 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:29.853408 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:29.854519 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:29.855127 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:29.855241 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:29.858110 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:29.858114 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:29.858114 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:29.858126 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:29.860132 (+ 2006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:29.860561 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:29.860564 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:29.860565 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:29.860699 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:29.860911 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:29.860912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:29.860912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:29.861221 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:29.861404 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:29.861475 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 18:46:29.861612 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
I20260809 18:46:29.876880 14078 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:46:29.877452 14078 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:46:29.883142 14078 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 545e1ac3b6fe45c1a7c1fec2ab192c27: Generated new TSK 0
I20260809 18:46:29.883329 14078 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
I20260809 18:46:29.911229 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:33825
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:37747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:30.005200 14101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:30.005576 14101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:30.005661 14101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:30.007746 14101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:30.007823 14101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:30.007881 14101 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:46:30.010555 14101 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:37747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:33825
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14101
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:30.010838 14101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:30.011116 14101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:30.018304 14111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:30.018335 14115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:30.018337 14110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:30.018880 14101 server_base.cc:1034] running on GCE node
I20260809 18:46:30.019100 14101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:30.019378 14101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:30.020587 14101 hybrid_clock.cc:648] HybridClock initialized: now 1786301190020569 us; error 34 us; skew 500 ppm
Aug 09 18:46:30 dist-test-slave-45dx krb5kdc[13926](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301190, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:30.024354 14101 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:46:30.024955 14101 webserver.cc:460] Webserver started at http://127.12.202.193:38861/ using document root <none> and password file <none>
I20260809 18:46:30.025252 14101 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:30.025312 14101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:30.025454 14101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:30.026636 14101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "c6a5081d6d8b4890920e922d32c0bafb"
format_stamp: "Formatted at 2026-08-09 18:46:30 on dist-test-slave-45dx"
server_key: "ebc4bfd19cab6386b84ef766432b961f"
server_key_iv: "c14f542b31ab5e6fa1591c13211f95a2"
server_key_version: "encryptionkey@0"
I20260809 18:46:30.027040 14101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "c6a5081d6d8b4890920e922d32c0bafb"
format_stamp: "Formatted at 2026-08-09 18:46:30 on dist-test-slave-45dx"
server_key: "ebc4bfd19cab6386b84ef766432b961f"
server_key_iv: "c14f542b31ab5e6fa1591c13211f95a2"
server_key_version: "encryptionkey@0"
I20260809 18:46:30.028630 14101 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:46:30.029490 14124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:30.029680 14101 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:30.029778 14101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "c6a5081d6d8b4890920e922d32c0bafb"
format_stamp: "Formatted at 2026-08-09 18:46:30 on dist-test-slave-45dx"
server_key: "ebc4bfd19cab6386b84ef766432b961f"
server_key_iv: "c14f542b31ab5e6fa1591c13211f95a2"
server_key_version: "encryptionkey@0"
I20260809 18:46:30.029870 14101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:30.041308 14101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:30.043120 14101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:30.043279 14101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:30.043512 14101 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:30.043813 14101 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:30.043866 14101 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:30.043927 14101 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:30.043953 14101 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:30.050338 14101 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:36127
I20260809 18:46:30.050391 14296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:36127 every 8 connection(s)
I20260809 18:46:30.050698 14101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
Aug 09 18:46:30 dist-test-slave-45dx krb5kdc[13926](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301190, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:30.058735 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 14101
I20260809 18:46:30.058857 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:46:30.059032 13099 external_mini_cluster.cc:1428] Setting key c1ee95fbb68149ac9264dd4c6901bc35
I20260809 18:46:30.060801 14299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.051329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:33825 (local address 127.12.202.193:33609)
0809 18:46:30.051515 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:30.051555 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:30.052642 (+ 1087us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:30.052910 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:30.052914 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:30.053159 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:30.053346 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:30.053350 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.054135 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.054136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:30.055085 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:30.055088 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.055549 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.055550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:30.055670 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.056197 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:30.056204 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:30.057701 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:30.059355 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:30.059369 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:30.059372 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:30.059602 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:30.059830 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:30.059831 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:30.059831 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:30.059953 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:30.060246 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:30.060251 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:30.060433 (+ 182us) client_negotiation.cc:769] Sending connection context
0809 18:46:30.060521 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 18:46:30.060650 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":92,"threads_started":1}
I20260809 18:46:30.060822 14057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.051385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:33609 (local address 127.12.202.254:33825)
0809 18:46:30.051477 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:30.051479 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:30.051636 (+ 157us) server_negotiation.cc:407] Connection header received
0809 18:46:30.052754 (+ 1118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:30.052756 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:30.052782 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:30.052838 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:30.053443 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.054041 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.055172 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.055465 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.055542 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.057785 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:30.057786 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:30.057786 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:30.057793 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:30.059254 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:30.059686 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:30.059687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:30.059687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:30.059754 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:30.060029 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:30.060030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:30.060031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:30.060178 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:30.060250 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:30.060582 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 18:46:30.060687 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 18:46:30.061903 14297 heartbeater.cc:347] Connected to a master server at 127.12.202.254:33825
I20260809 18:46:30.062021 14297 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:30.062219 14297 heartbeater.cc:511] Master 127.12.202.254:33825 requested a full tablet report, sending...
I20260809 18:46:30.062773 14001 ts_manager.cc:194] Registered new tserver with Master: c6a5081d6d8b4890920e922d32c0bafb (127.12.202.193:36127)
I20260809 18:46:30.063688 14001 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:33609
WARNING: no policy specified for kudu/127.12.202.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
I20260809 18:46:30.084880 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:33825
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:37747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:30.166508 14303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:30.166742 14303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:30.166786 14303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:30.167953 14303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:30.168020 14303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:30.168062 14303 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:46:30.169541 14303 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:37747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:33825
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:30.169811 14303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:30.170035 14303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:30.175194 14313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:30.175237 14316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:30.175230 14318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:30.175297 14303 server_base.cc:1034] running on GCE node
I20260809 18:46:30.175596 14303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:30.175890 14303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:30.177074 14303 hybrid_clock.cc:648] HybridClock initialized: now 1786301190177052 us; error 39 us; skew 500 ppm
Aug 09 18:46:30 dist-test-slave-45dx krb5kdc[13926](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301190, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:30.179658 14303 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:46:30.180115 14303 webserver.cc:460] Webserver started at http://127.12.202.194:46759/ using document root <none> and password file <none>
I20260809 18:46:30.180441 14303 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:30.180517 14303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:30.180658 14303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:30.181730 14303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "9000b57ca9a54cf8851c9aa49e2592dc"
format_stamp: "Formatted at 2026-08-09 18:46:30 on dist-test-slave-45dx"
server_key: "cc5f1a94134d3b9018f0004a9bd7b58d"
server_key_iv: "4dd632ae711f6106444619fb27975431"
server_key_version: "encryptionkey@0"
I20260809 18:46:30.182132 14303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "9000b57ca9a54cf8851c9aa49e2592dc"
format_stamp: "Formatted at 2026-08-09 18:46:30 on dist-test-slave-45dx"
server_key: "cc5f1a94134d3b9018f0004a9bd7b58d"
server_key_iv: "4dd632ae711f6106444619fb27975431"
server_key_version: "encryptionkey@0"
I20260809 18:46:30.183455 14303 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:46:30.184149 14326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:30.184374 14303 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:46:30.184468 14303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "9000b57ca9a54cf8851c9aa49e2592dc"
format_stamp: "Formatted at 2026-08-09 18:46:30 on dist-test-slave-45dx"
server_key: "cc5f1a94134d3b9018f0004a9bd7b58d"
server_key_iv: "4dd632ae711f6106444619fb27975431"
server_key_version: "encryptionkey@0"
I20260809 18:46:30.184552 14303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:30.199303 14303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:30.201534 14303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:30.201707 14303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:30.201998 14303 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:30.202337 14303 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:30.202395 14303 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:30.202440 14303 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:30.202468 14303 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:30.208209 14303 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:36825
I20260809 18:46:30.208331 14510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:36825 every 8 connection(s)
I20260809 18:46:30.208639 14303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:46:30.209694 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 14303
I20260809 18:46:30.209792 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:46:30.209965 13099 external_mini_cluster.cc:1428] Setting key e67530be396711ba32da2a60b1fd9fa7
Aug 09 18:46:30 dist-test-slave-45dx krb5kdc[13926](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301190, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:30.219378 14057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.209376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:37661 (local address 127.12.202.254:33825)
0809 18:46:30.209463 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:30.209465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:30.209649 (+ 184us) server_negotiation.cc:407] Connection header received
0809 18:46:30.210881 (+ 1232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:30.210882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:30.210892 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:30.210920 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:30.211789 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.212346 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.213332 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.213543 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.213627 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.216234 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:30.216236 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:30.216236 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:30.216243 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:30.217792 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:30.218336 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:30.218337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:30.218337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:30.218387 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:30.218685 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:30.218686 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:30.218686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:30.218812 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:30.218864 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:30.219245 (+ 381us) server_negotiation.cc:299] Negotiation successful
0809 18:46:30.219313 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 18:46:30.219729 14514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.209310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:33825 (local address 127.12.202.194:37661)
0809 18:46:30.209480 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:30.209544 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:30.210754 (+ 1210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:30.211006 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:30.211010 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:30.211419 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:30.211692 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:30.211698 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.212436 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.212437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:30.213239 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:30.213241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.213641 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.213642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:30.213775 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.214298 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:30.214306 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:30.216138 (+ 1832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:30.217903 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:30.217912 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:30.217915 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:30.218257 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:30.218455 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:30.218456 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:30.218456 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:30.218605 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:30.218882 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:30.218890 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:30.219081 (+ 191us) client_negotiation.cc:769] Sending connection context
0809 18:46:30.219220 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 18:46:30.219414 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
WARNING: no policy specified for kudu/127.12.202.195@KRBTEST.COM; defaulting to no policy
I20260809 18:46:30.220309 14511 heartbeater.cc:347] Connected to a master server at 127.12.202.254:33825
I20260809 18:46:30.220469 14511 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:30.220677 14511 heartbeater.cc:511] Master 127.12.202.254:33825 requested a full tablet report, sending...
I20260809 18:46:30.221088 14001 ts_manager.cc:194] Registered new tserver with Master: 9000b57ca9a54cf8851c9aa49e2592dc (127.12.202.194:36825)
I20260809 18:46:30.221519 14001 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:37661
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
I20260809 18:46:30.237433 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:33825
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:37747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:30.324112 14518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:30.324378 14518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:30.324420 14518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:30.325563 14518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:30.325600 14518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:30.325627 14518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:46:30.327081 14518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:37747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:33825
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:30.327280 14518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:30.327458 14518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:30.332717 14527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:30.332712 14528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:30.332894 14518 server_base.cc:1034] running on GCE node
W20260809 18:46:30.332930 14535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:30.333230 14518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:30.333509 14518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:30.334674 14518 hybrid_clock.cc:648] HybridClock initialized: now 1786301190334656 us; error 28 us; skew 500 ppm
Aug 09 18:46:30 dist-test-slave-45dx krb5kdc[13926](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301190, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:30.337258 14518 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:46:30.337744 14518 webserver.cc:460] Webserver started at http://127.12.202.195:36309/ using document root <none> and password file <none>
I20260809 18:46:30.337989 14518 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:30.338056 14518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:30.338199 14518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:30.339238 14518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "f6c8fa345c2f46ae9507911f1759e706"
format_stamp: "Formatted at 2026-08-09 18:46:30 on dist-test-slave-45dx"
server_key: "13d443dd0ba4cdb332ba720c27c6862e"
server_key_iv: "17b9e1e6a5c800201bdf32e2a9868826"
server_key_version: "encryptionkey@0"
I20260809 18:46:30.339596 14518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "f6c8fa345c2f46ae9507911f1759e706"
format_stamp: "Formatted at 2026-08-09 18:46:30 on dist-test-slave-45dx"
server_key: "13d443dd0ba4cdb332ba720c27c6862e"
server_key_iv: "17b9e1e6a5c800201bdf32e2a9868826"
server_key_version: "encryptionkey@0"
I20260809 18:46:30.341013 14518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 18:46:30.341773 14543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:30.342006 14518 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:46:30.342111 14518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "f6c8fa345c2f46ae9507911f1759e706"
format_stamp: "Formatted at 2026-08-09 18:46:30 on dist-test-slave-45dx"
server_key: "13d443dd0ba4cdb332ba720c27c6862e"
server_key_iv: "17b9e1e6a5c800201bdf32e2a9868826"
server_key_version: "encryptionkey@0"
I20260809 18:46:30.342182 14518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:30.349608 14518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:30.351372 14518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:30.351526 14518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:30.351724 14518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:30.351998 14518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:30.352051 14518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:30.352088 14518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:30.352113 14518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:30.358719 14518 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:40677
I20260809 18:46:30.358775 14715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:40677 every 8 connection(s)
I20260809 18:46:30.359050 14518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:46:30.362593 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 14518
I20260809 18:46:30.362676 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:46:30.362823 13099 external_mini_cluster.cc:1428] Setting key 39fe69f7218ee799189058260decac04
Aug 09 18:46:30 dist-test-slave-45dx krb5kdc[13926](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301190, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:30.368088 14057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.359741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:57471 (local address 127.12.202.254:33825)
0809 18:46:30.359785 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:30.359787 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:30.359940 (+ 153us) server_negotiation.cc:407] Connection header received
0809 18:46:30.360887 (+ 947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:30.360888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:30.360897 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:30.360956 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:30.361456 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.361964 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.363049 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.363362 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.363431 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.365415 (+ 1984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:30.365416 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:30.365417 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:30.365423 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:30.366845 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:30.367229 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:30.367230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:30.367230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:30.367282 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:30.367523 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:30.367524 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:30.367525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:30.367663 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:30.367732 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:30.367960 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 18:46:30.368025 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:46:30.368227 14719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.359672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:33825 (local address 127.12.202.195:57471)
0809 18:46:30.359838 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:30.359876 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:30.360799 (+ 923us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:30.361007 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:30.361009 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:30.361234 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:30.361390 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:30.361394 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.362046 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.362047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:30.362927 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:30.362930 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.363460 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.363462 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:30.363594 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.364007 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:30.364014 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:30.365332 (+ 1318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:30.366916 (+ 1584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:30.366921 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:30.366922 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:30.367152 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:30.367338 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:30.367338 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:30.367339 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:30.367429 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:30.367732 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:30.367737 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:30.367847 (+ 110us) client_negotiation.cc:769] Sending connection context
0809 18:46:30.367921 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 18:46:30.368031 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":81,"threads_started":1}
I20260809 18:46:30.368731 14717 heartbeater.cc:347] Connected to a master server at 127.12.202.254:33825
I20260809 18:46:30.368850 14717 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:30.368980 14717 heartbeater.cc:511] Master 127.12.202.254:33825 requested a full tablet report, sending...
I20260809 18:46:30.369313 14001 ts_manager.cc:194] Registered new tserver with Master: f6c8fa345c2f46ae9507911f1759e706 (127.12.202.195:40677)
I20260809 18:46:30.369704 14001 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:57471
I20260809 18:46:30.374385 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:46:30.381511 14057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.375974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51396 (local address 127.12.202.254:33825)
0809 18:46:30.376032 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:30.376034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:30.376122 (+ 88us) server_negotiation.cc:407] Connection header received
0809 18:46:30.376156 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:30.376157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:30.376165 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:30.376207 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:30.376767 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.377219 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.377907 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.378081 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.378129 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.379366 (+ 1237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:30.379367 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:30.379367 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:30.379372 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:30.380586 (+ 1214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:30.380889 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:30.380890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:30.380890 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:30.380941 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:30.381103 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:30.381103 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:30.381103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:30.381230 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:30.381304 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:30.381396 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 18:46:30.381451 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 18:46:30.383821 14001 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51396:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:46:30.385453 14001 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:46:30.391937 14736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.387810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:36825 (local address 127.0.0.1:41868)
0809 18:46:30.388137 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:30.388146 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:30.388190 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:30.388762 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:30.388762 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:30.388765 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:30.388806 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:30.388807 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.390055 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.390056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:30.390865 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:30.390868 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.391717 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.391718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:30.391777 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.391787 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 18:46:30.391845 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 18:46:30.391881 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"mutex_wait_us":2,"thread_start_us":82,"threads_started":1}
I20260809 18:46:30.392006 14741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.388232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41868 (local address 127.12.202.194:36825)
0809 18:46:30.388446 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:30.388449 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:30.388457 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:46:30.388489 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:30.388490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:30.388502 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:30.388600 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:30.388891 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.389949 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.390966 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.391639 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.391721 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.391772 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:30.391882 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 18:46:30.391927 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":106,"threads_started":1}
I20260809 18:46:30.392674 14401 tablet_service.cc:1467] Processing CreateTablet for tablet 8cb79f7141cc45e1894e4f45231079f0 (DEFAULT_TABLE table=test-table [id=5ee626cad8d94daea770f76326e116cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:30.393097 14401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cb79f7141cc45e1894e4f45231079f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:30.393136 14740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.388161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42428 (local address 127.12.202.193:36127)
0809 18:46:30.388758 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:30.388762 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:30.388772 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:46:30.388811 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:30.388813 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:30.388830 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:30.388904 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:30.389124 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.389796 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.392144 (+ 2348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.392697 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.392760 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.392792 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:30.393007 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 18:46:30.393053 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":87,"threads_started":1}
I20260809 18:46:30.393136 14734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.387796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:40677 (local address 127.0.0.1:60814)
0809 18:46:30.387911 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:30.387953 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:30.388013 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:30.388601 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:30.388604 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:30.388606 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:30.388680 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:30.388682 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.390018 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.390019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:30.391246 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:30.391249 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.392885 (+ 1636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.392886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:30.392952 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.392956 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:46:30.393011 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 18:46:30.393053 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88,"mutex_wait_us":74,"thread_start_us":67,"threads_started":1}
I20260809 18:46:30.393421 14737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.388024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60814 (local address 127.12.202.195:40677)
0809 18:46:30.388398 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:30.388402 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:30.388413 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:46:30.388467 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:30.388469 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:30.388491 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:30.388579 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:30.388756 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.389900 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.391340 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.392046 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.392878 (+ 832us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.392938 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:30.393321 (+ 383us) server_negotiation.cc:299] Negotiation successful
0809 18:46:30.393364 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":91,"threads_started":1}
I20260809 18:46:30.393139 14735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.388014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:36127 (local address 127.0.0.1:42428)
0809 18:46:30.388466 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:30.388478 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:30.388534 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:30.389000 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:30.389001 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:30.389003 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:30.389037 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:30.389038 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.389900 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.389901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:30.391246 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:30.391249 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.392785 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.392786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:30.392920 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.392926 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 18:46:30.392988 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 18:46:30.393040 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"mutex_wait_us":37,"thread_start_us":89,"threads_started":1}
I20260809 18:46:30.394135 14200 tablet_service.cc:1467] Processing CreateTablet for tablet 8cb79f7141cc45e1894e4f45231079f0 (DEFAULT_TABLE table=test-table [id=5ee626cad8d94daea770f76326e116cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:30.394137 14618 tablet_service.cc:1467] Processing CreateTablet for tablet 8cb79f7141cc45e1894e4f45231079f0 (DEFAULT_TABLE table=test-table [id=5ee626cad8d94daea770f76326e116cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:30.394459 14200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cb79f7141cc45e1894e4f45231079f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:30.394457 14618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cb79f7141cc45e1894e4f45231079f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:30.395980 14743 tablet_bootstrap.cc:492] T 8cb79f7141cc45e1894e4f45231079f0 P 9000b57ca9a54cf8851c9aa49e2592dc: Bootstrap starting.
I20260809 18:46:30.396941 14743 tablet_bootstrap.cc:654] T 8cb79f7141cc45e1894e4f45231079f0 P 9000b57ca9a54cf8851c9aa49e2592dc: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:30.397444 14743 log.cc:824] T 8cb79f7141cc45e1894e4f45231079f0 P 9000b57ca9a54cf8851c9aa49e2592dc: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:30.397749 14745 tablet_bootstrap.cc:492] T 8cb79f7141cc45e1894e4f45231079f0 P f6c8fa345c2f46ae9507911f1759e706: Bootstrap starting.
I20260809 18:46:30.398011 14744 tablet_bootstrap.cc:492] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb: Bootstrap starting.
I20260809 18:46:30.398275 14743 tablet_bootstrap.cc:492] T 8cb79f7141cc45e1894e4f45231079f0 P 9000b57ca9a54cf8851c9aa49e2592dc: No bootstrap required, opened a new log
I20260809 18:46:30.398379 14743 ts_tablet_manager.cc:1397] T 8cb79f7141cc45e1894e4f45231079f0 P 9000b57ca9a54cf8851c9aa49e2592dc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:46:30.398662 14744 tablet_bootstrap.cc:654] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:30.399142 14744 log.cc:824] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:30.399992 14744 tablet_bootstrap.cc:492] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb: No bootstrap required, opened a new log
I20260809 18:46:30.400046 14745 tablet_bootstrap.cc:654] T 8cb79f7141cc45e1894e4f45231079f0 P f6c8fa345c2f46ae9507911f1759e706: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:30.400154 14744 ts_tablet_manager.cc:1397] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:46:30.400060 14743 raft_consensus.cc:348] T 8cb79f7141cc45e1894e4f45231079f0 P 9000b57ca9a54cf8851c9aa49e2592dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c8fa345c2f46ae9507911f1759e706" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 40677 } } peers { permanent_uuid: "9000b57ca9a54cf8851c9aa49e2592dc" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36825 } } peers { permanent_uuid: "c6a5081d6d8b4890920e922d32c0bafb" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36127 } }
I20260809 18:46:30.400233 14743 raft_consensus.cc:374] T 8cb79f7141cc45e1894e4f45231079f0 P 9000b57ca9a54cf8851c9aa49e2592dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:30.400283 14743 raft_consensus.cc:729] T 8cb79f7141cc45e1894e4f45231079f0 P 9000b57ca9a54cf8851c9aa49e2592dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9000b57ca9a54cf8851c9aa49e2592dc, State: Initialized, Role: FOLLOWER
I20260809 18:46:30.400426 14743 consensus_queue.cc:260] T 8cb79f7141cc45e1894e4f45231079f0 P 9000b57ca9a54cf8851c9aa49e2592dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c8fa345c2f46ae9507911f1759e706" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 40677 } } peers { permanent_uuid: "9000b57ca9a54cf8851c9aa49e2592dc" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36825 } } peers { permanent_uuid: "c6a5081d6d8b4890920e922d32c0bafb" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36127 } }
I20260809 18:46:30.400718 14743 ts_tablet_manager.cc:1428] T 8cb79f7141cc45e1894e4f45231079f0 P 9000b57ca9a54cf8851c9aa49e2592dc: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 18:46:30.400722 14745 log.cc:824] T 8cb79f7141cc45e1894e4f45231079f0 P f6c8fa345c2f46ae9507911f1759e706: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:30.400844 14511 heartbeater.cc:503] Master 127.12.202.254:33825 was elected leader, sending a full tablet report...
I20260809 18:46:30.401489 14745 tablet_bootstrap.cc:492] T 8cb79f7141cc45e1894e4f45231079f0 P f6c8fa345c2f46ae9507911f1759e706: No bootstrap required, opened a new log
I20260809 18:46:30.401569 14745 ts_tablet_manager.cc:1397] T 8cb79f7141cc45e1894e4f45231079f0 P f6c8fa345c2f46ae9507911f1759e706: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 18:46:30.402551 14744 raft_consensus.cc:348] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c8fa345c2f46ae9507911f1759e706" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 40677 } } peers { permanent_uuid: "9000b57ca9a54cf8851c9aa49e2592dc" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36825 } } peers { permanent_uuid: "c6a5081d6d8b4890920e922d32c0bafb" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36127 } }
I20260809 18:46:30.402704 14744 raft_consensus.cc:374] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:30.402755 14744 raft_consensus.cc:729] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a5081d6d8b4890920e922d32c0bafb, State: Initialized, Role: FOLLOWER
I20260809 18:46:30.402864 14744 consensus_queue.cc:260] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c8fa345c2f46ae9507911f1759e706" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 40677 } } peers { permanent_uuid: "9000b57ca9a54cf8851c9aa49e2592dc" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36825 } } peers { permanent_uuid: "c6a5081d6d8b4890920e922d32c0bafb" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36127 } }
I20260809 18:46:30.403184 14744 ts_tablet_manager.cc:1428] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:46:30.403224 14297 heartbeater.cc:503] Master 127.12.202.254:33825 was elected leader, sending a full tablet report...
I20260809 18:46:30.403383 14745 raft_consensus.cc:348] T 8cb79f7141cc45e1894e4f45231079f0 P f6c8fa345c2f46ae9507911f1759e706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c8fa345c2f46ae9507911f1759e706" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 40677 } } peers { permanent_uuid: "9000b57ca9a54cf8851c9aa49e2592dc" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36825 } } peers { permanent_uuid: "c6a5081d6d8b4890920e922d32c0bafb" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36127 } }
I20260809 18:46:30.403594 14745 raft_consensus.cc:374] T 8cb79f7141cc45e1894e4f45231079f0 P f6c8fa345c2f46ae9507911f1759e706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:30.403646 14745 raft_consensus.cc:729] T 8cb79f7141cc45e1894e4f45231079f0 P f6c8fa345c2f46ae9507911f1759e706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c8fa345c2f46ae9507911f1759e706, State: Initialized, Role: FOLLOWER
I20260809 18:46:30.403755 14745 consensus_queue.cc:260] T 8cb79f7141cc45e1894e4f45231079f0 P f6c8fa345c2f46ae9507911f1759e706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c8fa345c2f46ae9507911f1759e706" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 40677 } } peers { permanent_uuid: "9000b57ca9a54cf8851c9aa49e2592dc" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36825 } } peers { permanent_uuid: "c6a5081d6d8b4890920e922d32c0bafb" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36127 } }
I20260809 18:46:30.404042 14745 ts_tablet_manager.cc:1428] T 8cb79f7141cc45e1894e4f45231079f0 P f6c8fa345c2f46ae9507911f1759e706: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 18:46:30.404241 14752 raft_consensus.cc:482] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:46:30.404342 14717 heartbeater.cc:503] Master 127.12.202.254:33825 was elected leader, sending a full tablet report...
I20260809 18:46:30.404474 14752 raft_consensus.cc:504] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c8fa345c2f46ae9507911f1759e706" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 40677 } } peers { permanent_uuid: "9000b57ca9a54cf8851c9aa49e2592dc" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36825 } } peers { permanent_uuid: "c6a5081d6d8b4890920e922d32c0bafb" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36127 } }
I20260809 18:46:30.405440 14752 leader_election.cc:288] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c8fa345c2f46ae9507911f1759e706 (127.12.202.195:40677), 9000b57ca9a54cf8851c9aa49e2592dc (127.12.202.194:36825)
I20260809 18:46:30.408248 14737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.405035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:40405 (local address 127.12.202.195:40677)
0809 18:46:30.405072 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:30.405074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:30.405082 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:46:30.405162 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:30.405163 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:30.405173 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:30.405254 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:30.405438 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.406141 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.407519 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.407887 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.407972 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.407980 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:30.408148 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 18:46:30.408183 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 18:46:30.408248 14299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.404988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:40677 (local address 127.12.202.193:40405)
0809 18:46:30.405041 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:30.405052 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:30.405093 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:30.405260 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:30.405261 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:30.405263 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:30.405347 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:30.405349 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.406211 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.406212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:30.407455 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:30.407458 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.407971 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.407972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:30.408054 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.408059 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:46:30.408139 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 18:46:30.408181 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 18:46:30.408550 14647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cb79f7141cc45e1894e4f45231079f0" candidate_uuid: "c6a5081d6d8b4890920e922d32c0bafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c8fa345c2f46ae9507911f1759e706" is_pre_election: true
I20260809 18:46:30.408653 14647 raft_consensus.cc:2454] T 8cb79f7141cc45e1894e4f45231079f0 P f6c8fa345c2f46ae9507911f1759e706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a5081d6d8b4890920e922d32c0bafb in term 0.
I20260809 18:46:30.408982 14126 leader_election.cc:302] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a5081d6d8b4890920e922d32c0bafb, f6c8fa345c2f46ae9507911f1759e706; no voters:
I20260809 18:46:30.409112 14752 raft_consensus.cc:2781] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:46:30.409164 14752 raft_consensus.cc:482] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:46:30.409204 14752 raft_consensus.cc:3037] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:30.409229 14741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.405770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:46911 (local address 127.12.202.194:36825)
0809 18:46:30.405853 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:30.405855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:30.406369 (+ 514us) server_negotiation.cc:407] Connection header received
0809 18:46:30.406428 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:30.406429 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:30.406438 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:30.406505 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:30.406697 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.407384 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.408235 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.408861 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.408928 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.408936 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:30.409117 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 18:46:30.409158 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 18:46:30.409282 14754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.405289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:36825 (local address 127.12.202.193:46911)
0809 18:46:30.406306 (+ 1017us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:30.406317 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:30.406380 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:30.406507 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:30.406508 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:30.406509 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:30.406630 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:30.406631 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.407470 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.407471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:30.408142 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:30.408144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.408962 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.408963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:30.409033 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.409037 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:46:30.409102 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 18:46:30.409140 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":999,"thread_start_us":120,"threads_started":1}
I20260809 18:46:30.409617 14435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cb79f7141cc45e1894e4f45231079f0" candidate_uuid: "c6a5081d6d8b4890920e922d32c0bafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9000b57ca9a54cf8851c9aa49e2592dc" is_pre_election: true
I20260809 18:46:30.409761 14435 raft_consensus.cc:2454] T 8cb79f7141cc45e1894e4f45231079f0 P 9000b57ca9a54cf8851c9aa49e2592dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a5081d6d8b4890920e922d32c0bafb in term 0.
I20260809 18:46:30.410172 14752 raft_consensus.cc:504] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c8fa345c2f46ae9507911f1759e706" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 40677 } } peers { permanent_uuid: "9000b57ca9a54cf8851c9aa49e2592dc" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36825 } } peers { permanent_uuid: "c6a5081d6d8b4890920e922d32c0bafb" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36127 } }
I20260809 18:46:30.410315 14752 leader_election.cc:288] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb [CANDIDATE]: Term 1 election: Requested vote from peers f6c8fa345c2f46ae9507911f1759e706 (127.12.202.195:40677), 9000b57ca9a54cf8851c9aa49e2592dc (127.12.202.194:36825)
I20260809 18:46:30.410454 14647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cb79f7141cc45e1894e4f45231079f0" candidate_uuid: "c6a5081d6d8b4890920e922d32c0bafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c8fa345c2f46ae9507911f1759e706"
I20260809 18:46:30.410480 14435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cb79f7141cc45e1894e4f45231079f0" candidate_uuid: "c6a5081d6d8b4890920e922d32c0bafb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9000b57ca9a54cf8851c9aa49e2592dc"
I20260809 18:46:30.410532 14647 raft_consensus.cc:3037] T 8cb79f7141cc45e1894e4f45231079f0 P f6c8fa345c2f46ae9507911f1759e706 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:30.410535 14435 raft_consensus.cc:3037] T 8cb79f7141cc45e1894e4f45231079f0 P 9000b57ca9a54cf8851c9aa49e2592dc [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:30.411398 14435 raft_consensus.cc:2454] T 8cb79f7141cc45e1894e4f45231079f0 P 9000b57ca9a54cf8851c9aa49e2592dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a5081d6d8b4890920e922d32c0bafb in term 1.
I20260809 18:46:30.411398 14647 raft_consensus.cc:2454] T 8cb79f7141cc45e1894e4f45231079f0 P f6c8fa345c2f46ae9507911f1759e706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a5081d6d8b4890920e922d32c0bafb in term 1.
I20260809 18:46:30.411571 14133 leader_election.cc:302] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9000b57ca9a54cf8851c9aa49e2592dc, c6a5081d6d8b4890920e922d32c0bafb; no voters:
I20260809 18:46:30.411715 14752 raft_consensus.cc:2781] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:30.411852 14752 raft_consensus.cc:686] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb [term 1 LEADER]: Becoming Leader. State: Replica: c6a5081d6d8b4890920e922d32c0bafb, State: Running, Role: LEADER
I20260809 18:46:30.411960 14752 consensus_queue.cc:237] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c8fa345c2f46ae9507911f1759e706" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 40677 } } peers { permanent_uuid: "9000b57ca9a54cf8851c9aa49e2592dc" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36825 } } peers { permanent_uuid: "c6a5081d6d8b4890920e922d32c0bafb" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36127 } }
I20260809 18:46:30.412715 14001 catalog_manager.cc:5495] T 8cb79f7141cc45e1894e4f45231079f0 P c6a5081d6d8b4890920e922d32c0bafb reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a5081d6d8b4890920e922d32c0bafb (127.12.202.193). New cstate: current_term: 1 leader_uuid: "c6a5081d6d8b4890920e922d32c0bafb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6c8fa345c2f46ae9507911f1759e706" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 40677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9000b57ca9a54cf8851c9aa49e2592dc" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a5081d6d8b4890920e922d32c0bafb" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36127 } health_report { overall_health: HEALTHY } } }
Aug 09 18:46:30 dist-test-slave-45dx krb5kdc[13926](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301189, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.193@KRBTEST.COM
I20260809 18:46:30.423815 14740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.416691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42432 (local address 127.12.202.193:36127)
0809 18:46:30.416753 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:30.416755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:30.416894 (+ 139us) server_negotiation.cc:407] Connection header received
0809 18:46:30.416940 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:30.416940 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:30.416949 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:30.416995 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:30.417520 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.417946 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.418569 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.418731 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.418776 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.421218 (+ 2442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:30.421226 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:30.421226 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:30.421232 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:30.422713 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:30.423090 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:30.423093 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:30.423093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:30.423148 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:30.423311 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:30.423312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:30.423312 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:30.423435 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:30.423581 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:30.423624 (+ 43us) server_negotiation.cc:299] Negotiation successful
0809 18:46:30.423683 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Aug 09 18:46:30 dist-test-slave-45dx krb5kdc[13926](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301190, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 18:46:30 dist-test-slave-45dx krb5kdc[13926](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301190, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.202.193@KRBTEST.COM
I20260809 18:46:30.448782 14740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.441033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42446 (local address 127.12.202.193:36127)
0809 18:46:30.441094 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:30.441097 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:30.441196 (+ 99us) server_negotiation.cc:407] Connection header received
0809 18:46:30.441240 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:30.441241 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:30.441251 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:30.441301 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:30.441844 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.442321 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.442994 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.443171 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.443219 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.445632 (+ 2413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:30.445633 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:30.445634 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:30.445641 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:30.447454 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:30.447841 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:30.447843 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:30.447843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:30.447916 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:30.448144 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:30.448144 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:30.448145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:30.448250 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:30.448386 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:30.448600 (+ 214us) server_negotiation.cc:299] Negotiation successful
0809 18:46:30.448680 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260809 18:46:30.459201 14512 tablet.cc:2369] T 8cb79f7141cc45e1894e4f45231079f0 P 9000b57ca9a54cf8851c9aa49e2592dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 18:46:30 dist-test-slave-45dx krb5kdc[13926](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 18:46:30 dist-test-slave-45dx krb5kdc[13926](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.193@KRBTEST.COM
I20260809 18:46:30.474866 14740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:30.468181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42452 (local address 127.12.202.193:36127)
0809 18:46:30.468246 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:30.468249 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:30.468431 (+ 182us) server_negotiation.cc:407] Connection header received
0809 18:46:30.468473 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:30.468474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:30.468483 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:30.468537 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:30.469052 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.469523 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.470198 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:30.470391 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:30.470441 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:30.472649 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:30.472651 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:30.472651 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:30.472657 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:30.473848 (+ 1191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:30.474152 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:30.474153 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:30.474153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:30.474218 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:30.474384 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:30.474384 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:30.474385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:30.474477 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:30.474566 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:30.474709 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 18:46:30.474789 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260809 18:46:30.475540 14166 tablet_service.cc:2908] Rejecting scan request for tablet 8cb79f7141cc45e1894e4f45231079f0: Uninitialized: clean time has not yet been initialized
I20260809 18:46:30.476576 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 14101
I20260809 18:46:30.493708 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 14303
I20260809 18:46:30.503027 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 14518
I20260809 18:46:30.513741 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 13945
2026-08-09T18:46:30Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (3508 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:46:30 dist-test-slave-45dx krb5kdc[14775](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:46:30 dist-test-slave-45dx krb5kdc[14775](info): set up 2 sockets
Aug 09 18:46:30 dist-test-slave-45dx krb5kdc[14775](info): commencing operation
krb5kdc: starting...
W20260809 18:46:31.765372 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:46:31 dist-test-slave-45dx krb5kdc[14775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:46:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:46:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:46:31.888595 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:39661
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:35801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:39661
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:31.969579 14802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:31.969781 14802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:31.969805 14802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:31.970808 14802 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:46:31.970840 14802 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 18:46:31.970852 14802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:31.970865 14802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:31.970875 14802 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:46:31.970885 14802 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:46:31.972234 14802 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:35801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:39661
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:39661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:31.972508 14802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:31.972690 14802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:31.977442 14809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:31.977452 14812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:31.977452 14810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:31.977627 14802 server_base.cc:1034] running on GCE node
I20260809 18:46:31.978000 14802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:31.978322 14802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:31.979493 14802 hybrid_clock.cc:648] HybridClock initialized: now 1786301191979487 us; error 50 us; skew 500 ppm
Aug 09 18:46:31 dist-test-slave-45dx krb5kdc[14775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301191, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:31.985988 14802 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:46:31.986410 14802 webserver.cc:460] Webserver started at http://127.12.202.254:45641/ using document root <none> and password file <none>
I20260809 18:46:31.986635 14802 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:31.986706 14802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:31.986862 14802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:31.987907 14802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "3e7a258166da48d9947d3df2fcd200a7"
format_stamp: "Formatted at 2026-08-09 18:46:31 on dist-test-slave-45dx"
server_key: "70d59bb0341b1c225fbd5e978fb93bc6"
server_key_iv: "e328b75e31f70f764209714cf21d0817"
server_key_version: "encryptionkey@0"
I20260809 18:46:31.988282 14802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "3e7a258166da48d9947d3df2fcd200a7"
format_stamp: "Formatted at 2026-08-09 18:46:31 on dist-test-slave-45dx"
server_key: "70d59bb0341b1c225fbd5e978fb93bc6"
server_key_iv: "e328b75e31f70f764209714cf21d0817"
server_key_version: "encryptionkey@0"
I20260809 18:46:31.989624 14802 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:31.990340 14821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:31.990514 14802 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:31.990618 14802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "3e7a258166da48d9947d3df2fcd200a7"
format_stamp: "Formatted at 2026-08-09 18:46:31 on dist-test-slave-45dx"
server_key: "70d59bb0341b1c225fbd5e978fb93bc6"
server_key_iv: "e328b75e31f70f764209714cf21d0817"
server_key_version: "encryptionkey@0"
I20260809 18:46:31.990701 14802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:31.999207 14802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:32.001335 14802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:32.001591 14802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:32.006301 14802 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:39661
I20260809 18:46:32.006415 14920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:39661 every 8 connection(s)
I20260809 18:46:32.006690 14802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:46:32.007372 14921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:32.009644 14921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7: Bootstrap starting.
I20260809 18:46:32.010291 14921 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:32.010583 14921 log.cc:824] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:32.011243 14921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7: No bootstrap required, opened a new log
I20260809 18:46:32.013041 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 14802
I20260809 18:46:32.013161 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:46:32.013314 13099 external_mini_cluster.cc:1428] Setting key 5affb19a1e313608759774bda59311ec
I20260809 18:46:32.013548 14921 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7a258166da48d9947d3df2fcd200a7" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39661 } }
I20260809 18:46:32.013718 14921 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:32.013800 14921 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e7a258166da48d9947d3df2fcd200a7, State: Initialized, Role: FOLLOWER
I20260809 18:46:32.013935 14921 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7a258166da48d9947d3df2fcd200a7" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39661 } }
I20260809 18:46:32.014021 14921 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:46:32.014062 14921 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:46:32.014110 14921 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:32.014803 14921 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7a258166da48d9947d3df2fcd200a7" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39661 } }
I20260809 18:46:32.014931 14921 leader_election.cc:302] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e7a258166da48d9947d3df2fcd200a7; no voters:
I20260809 18:46:32.015095 14921 leader_election.cc:288] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:46:32.015125 14928 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:32.015314 14928 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7 [term 1 LEADER]: Becoming Leader. State: Replica: 3e7a258166da48d9947d3df2fcd200a7, State: Running, Role: LEADER
I20260809 18:46:32.015336 14921 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:32.015470 14928 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7a258166da48d9947d3df2fcd200a7" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39661 } }
I20260809 18:46:32.015822 14929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e7a258166da48d9947d3df2fcd200a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7a258166da48d9947d3df2fcd200a7" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39661 } } }
I20260809 18:46:32.015899 14929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7 [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:32.016170 14933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e7a258166da48d9947d3df2fcd200a7. Latest consensus state: current_term: 1 leader_uuid: "3e7a258166da48d9947d3df2fcd200a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7a258166da48d9947d3df2fcd200a7" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39661 } } }
I20260809 18:46:32.016271 14933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7 [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:32.016621 14938 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:46:32.017180 14938 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:46:32.018993 14938 catalog_manager.cc:1347] Generated new cluster ID: b2c26abd68584a5f85c2136c6d7c87bd
I20260809 18:46:32.019053 14938 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:46:32 dist-test-slave-45dx krb5kdc[14775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:32.024649 14926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.013805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53264 (local address 127.12.202.254:39661)
0809 18:46:32.013977 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:32.013984 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:32.014009 (+ 25us) server_negotiation.cc:407] Connection header received
0809 18:46:32.014146 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:32.014151 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:32.014222 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:32.014326 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:32.015119 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.016655 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.017754 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.018292 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.018410 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.020833 (+ 2423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:32.020837 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:32.020837 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:32.020848 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:32.023117 (+ 2269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:32.023513 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:32.023515 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:32.023516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:32.023625 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:32.023833 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:32.023834 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:32.023834 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:32.024051 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:32.024223 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:32.024334 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 18:46:32.024485 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":96,"threads_started":1}
I20260809 18:46:32.057544 14938 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:46:32.058127 14938 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:46:32.062199 14938 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7: Generated new TSK 0
I20260809 18:46:32.062417 14938 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
I20260809 18:46:32.101007 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39661
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:35801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:32.182910 14962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:32.183111 14962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:32.183133 14962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:32.184176 14962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:32.184207 14962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:32.184244 14962 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:46:32.184260 14962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:46:32.185748 14962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:35801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.202.254:39661
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:32.185930 14962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:32.186127 14962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:32.191164 14972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:32.191228 14970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:32.191198 14977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:32.191279 14962 server_base.cc:1034] running on GCE node
I20260809 18:46:32.191699 14962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:32.191924 14962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:32.193073 14962 hybrid_clock.cc:648] HybridClock initialized: now 1786301192193062 us; error 32 us; skew 500 ppm
Aug 09 18:46:32 dist-test-slave-45dx krb5kdc[14775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301192, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:32.195714 14962 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:46:32.196165 14962 webserver.cc:460] Webserver started at http://127.12.202.193:37109/ using document root <none> and password file <none>
I20260809 18:46:32.196453 14962 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:32.196529 14962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:32.196691 14962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:32.197738 14962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "e5e6a88a0d72405096fc50671e4b1ed7"
format_stamp: "Formatted at 2026-08-09 18:46:32 on dist-test-slave-45dx"
server_key: "b1bcc1796c120554062d011f0b277f25"
server_key_iv: "ffd578a1c460a4a65fa21fdc7865488e"
server_key_version: "encryptionkey@0"
I20260809 18:46:32.198117 14962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "e5e6a88a0d72405096fc50671e4b1ed7"
format_stamp: "Formatted at 2026-08-09 18:46:32 on dist-test-slave-45dx"
server_key: "b1bcc1796c120554062d011f0b277f25"
server_key_iv: "ffd578a1c460a4a65fa21fdc7865488e"
server_key_version: "encryptionkey@0"
I20260809 18:46:32.199477 14962 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:46:32.200201 14986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:32.200392 14962 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:32.200500 14962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "e5e6a88a0d72405096fc50671e4b1ed7"
format_stamp: "Formatted at 2026-08-09 18:46:32 on dist-test-slave-45dx"
server_key: "b1bcc1796c120554062d011f0b277f25"
server_key_iv: "ffd578a1c460a4a65fa21fdc7865488e"
server_key_version: "encryptionkey@0"
I20260809 18:46:32.200574 14962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:32.208963 14962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:32.210685 14962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:32.210839 14962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:32.211316 14962 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:32.211383 14962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:32.211427 14962 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:32.211452 14962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 18:46:32 dist-test-slave-45dx krb5kdc[14775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301192, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:32.218502 14962 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:43033
I20260809 18:46:32.218554 15158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:43033 every 8 connection(s)
I20260809 18:46:32.218920 14962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:46:32.221406 14926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.211798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:36897 (local address 127.12.202.254:39661)
0809 18:46:32.211843 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:32.211845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:32.212049 (+ 204us) server_negotiation.cc:407] Connection header received
0809 18:46:32.212602 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:32.212603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:32.212617 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:32.212680 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:32.213478 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.214248 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.215823 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.216192 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.216271 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.218796 (+ 2525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:32.218798 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:32.218798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:32.218807 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:32.220150 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:32.220613 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:32.220614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:32.220614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:32.220667 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:32.220878 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:32.220878 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:32.220879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:32.220998 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:32.221046 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:32.221269 (+ 223us) server_negotiation.cc:299] Negotiation successful
0809 18:46:32.221333 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 18:46:32.221565 14998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.211786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:39661 (local address 127.12.202.193:36897)
0809 18:46:32.211921 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:32.211953 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:32.212495 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:32.212757 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:32.212760 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:32.213101 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:32.213361 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.213367 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.214371 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.214372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.215727 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.215730 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.216334 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.216335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.216510 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.217030 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:32.217058 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:32.218705 (+ 1647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:32.220218 (+ 1513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:32.220225 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:32.220226 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:32.220551 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:32.220725 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:32.220725 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:32.220726 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:32.220820 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:32.221049 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:32.221054 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:32.221158 (+ 104us) client_negotiation.cc:769] Sending connection context
0809 18:46:32.221236 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 18:46:32.221349 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":79,"threads_started":1}
I20260809 18:46:32.222155 15160 heartbeater.cc:347] Connected to a master server at 127.12.202.254:39661
I20260809 18:46:32.222245 15160 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:32.222447 15160 heartbeater.cc:511] Master 127.12.202.254:39661 requested a full tablet report, sending...
I20260809 18:46:32.223032 14841 ts_manager.cc:194] Registered new tserver with Master: e5e6a88a0d72405096fc50671e4b1ed7 (127.12.202.193:43033)
I20260809 18:46:32.223873 14841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:36897
I20260809 18:46:32.225886 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 14962
I20260809 18:46:32.226006 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:46:32.226176 13099 external_mini_cluster.cc:1428] Setting key 9b96eb5346382f7e2c072b35210d550f
I20260809 18:46:32.228883 14926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.223414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:46721 (local address 127.12.202.254:39661)
0809 18:46:32.223454 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:32.223456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:32.223463 (+ 7us) server_negotiation.cc:407] Connection header received
0809 18:46:32.223482 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:32.223483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:32.223494 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:32.223551 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:32.223844 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.224472 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.225138 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.225309 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.225389 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.226381 (+ 992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:32.226382 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:32.226383 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:32.226390 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:32.227719 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:32.228051 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:32.228052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:32.228052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:32.228107 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:32.228365 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:32.228366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:32.228372 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:32.228482 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:32.228556 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:32.228718 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 18:46:32.228793 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:46:32.228909 15167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.223204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:39661 (local address 127.12.202.193:46721)
0809 18:46:32.223335 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:32.223345 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:32.223416 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:32.223560 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:32.223561 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:32.223729 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:32.223775 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.223777 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.224574 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.224575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.225070 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.225071 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.225396 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.225397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.225451 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.225917 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:32.225922 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:32.226299 (+ 377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:32.227802 (+ 1503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:32.227803 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:32.227804 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:32.227978 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:32.228205 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:32.228206 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:32.228206 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:32.228273 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:32.228558 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:32.228560 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:32.228607 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 18:46:32.228691 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 18:46:32.228796 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":98,"threads_started":1}
WARNING: no policy specified for kudu/127.12.202.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
I20260809 18:46:32.252645 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39661
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:35801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:32.337591 15173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:32.337824 15173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:32.337848 15173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:32.338986 15173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:32.339027 15173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:32.339047 15173 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:46:32.339104 15173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:46:32.340539 15173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:35801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.202.254:39661
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:32.340790 15173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:32.341035 15173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:32.346489 15188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:32.346459 15181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:32.346457 15180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:32.346499 15173 server_base.cc:1034] running on GCE node
I20260809 18:46:32.346873 15173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:32.347128 15173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:32.348295 15173 hybrid_clock.cc:648] HybridClock initialized: now 1786301192348295 us; error 50 us; skew 500 ppm
Aug 09 18:46:32 dist-test-slave-45dx krb5kdc[14775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301192, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:32.350829 15173 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:46:32.351241 15173 webserver.cc:460] Webserver started at http://127.12.202.194:36099/ using document root <none> and password file <none>
I20260809 18:46:32.351467 15173 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:32.351536 15173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:32.351675 15173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:32.352795 15173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "432ed58c18124ed886d5753858bf60f1"
format_stamp: "Formatted at 2026-08-09 18:46:32 on dist-test-slave-45dx"
server_key: "a6015897878108eadbe2b227f88edc91"
server_key_iv: "b3f6de9374b182ddf3bc18d8786ff787"
server_key_version: "encryptionkey@0"
I20260809 18:46:32.353159 15173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "432ed58c18124ed886d5753858bf60f1"
format_stamp: "Formatted at 2026-08-09 18:46:32 on dist-test-slave-45dx"
server_key: "a6015897878108eadbe2b227f88edc91"
server_key_iv: "b3f6de9374b182ddf3bc18d8786ff787"
server_key_version: "encryptionkey@0"
I20260809 18:46:32.354452 15173 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:46:32.355193 15197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:32.355376 15173 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:32.355480 15173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "432ed58c18124ed886d5753858bf60f1"
format_stamp: "Formatted at 2026-08-09 18:46:32 on dist-test-slave-45dx"
server_key: "a6015897878108eadbe2b227f88edc91"
server_key_iv: "b3f6de9374b182ddf3bc18d8786ff787"
server_key_version: "encryptionkey@0"
I20260809 18:46:32.355562 15173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:32.367870 15173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:32.369885 15173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:32.370069 15173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:32.370595 15173 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:32.370661 15173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:32.370725 15173 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:32.370754 15173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:32.378047 15173 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:34243
I20260809 18:46:32.378111 15405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:34243 every 8 connection(s)
Aug 09 18:46:32 dist-test-slave-45dx krb5kdc[14775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301192, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:32.378425 15173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:46:32.381290 14926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.371175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:55693 (local address 127.12.202.254:39661)
0809 18:46:32.371222 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:32.371224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:32.371584 (+ 360us) server_negotiation.cc:407] Connection header received
0809 18:46:32.372259 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:32.372260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:32.372275 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:32.372384 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:32.373193 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.374024 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.375574 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.375881 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.375958 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.378669 (+ 2711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:32.378671 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:32.378671 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:32.378679 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:32.379826 (+ 1147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:32.380266 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:32.380268 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:32.380268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:32.380356 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:32.380644 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:32.380644 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:32.380645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:32.380762 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:32.380838 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:32.381108 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 18:46:32.381189 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:46:32.381477 15219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.371141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:39661 (local address 127.12.202.194:55693)
0809 18:46:32.371389 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:32.371459 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:32.372169 (+ 710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:32.372455 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:32.372458 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:32.372807 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:32.373077 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.373084 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.374128 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.374130 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.375493 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.375497 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.375985 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.375986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.376146 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.376696 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:32.376716 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:32.378576 (+ 1860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:32.379948 (+ 1372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:32.379956 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:32.379958 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:32.380187 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:32.380447 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:32.380448 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:32.380448 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:32.380569 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:32.380829 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:32.380836 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:32.380975 (+ 139us) client_negotiation.cc:769] Sending connection context
0809 18:46:32.381083 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 18:46:32.381235 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":88,"threads_started":1}
I20260809 18:46:32.382023 15408 heartbeater.cc:347] Connected to a master server at 127.12.202.254:39661
I20260809 18:46:32.382109 15408 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:32.382316 15408 heartbeater.cc:511] Master 127.12.202.254:39661 requested a full tablet report, sending...
I20260809 18:46:32.382669 14840 ts_manager.cc:194] Registered new tserver with Master: 432ed58c18124ed886d5753858bf60f1 (127.12.202.194:34243)
I20260809 18:46:32.383046 14840 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:55693
I20260809 18:46:32.388113 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 15173
I20260809 18:46:32.388207 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:46:32.388439 13099 external_mini_cluster.cc:1428] Setting key 8c2b72bdadab22c0f1c8980dd2a4f6bb
I20260809 18:46:32.388854 15420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.383097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:39661 (local address 127.12.202.194:49323)
0809 18:46:32.383229 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:32.383239 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:32.383287 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:32.383510 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:32.383511 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:32.383663 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:32.383714 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.383715 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.384418 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.384418 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.384891 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.384892 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.385185 (+ 293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.385186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.385239 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.385683 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:32.385688 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:32.385977 (+ 289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:32.387501 (+ 1524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:32.387501 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:32.387502 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:32.387656 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:32.387924 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:32.387925 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:32.387925 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:32.387989 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:32.388491 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:32.388492 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:32.388544 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 18:46:32.388627 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 18:46:32.388747 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":76,"threads_started":1}
I20260809 18:46:32.388926 14926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.383163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:49323 (local address 127.12.202.254:39661)
0809 18:46:32.383396 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:32.383398 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:32.383406 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:46:32.383427 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:32.383428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:32.383438 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:32.383499 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:32.383793 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.384267 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.384955 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.385122 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.385170 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.386048 (+ 878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:32.386049 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:32.386049 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:32.386053 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:32.387418 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:32.387756 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:32.387757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:32.387758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:32.387810 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:32.388098 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:32.388098 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:32.388098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:32.388411 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:32.388484 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:32.388729 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 18:46:32.388816 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186}
WARNING: no policy specified for kudu/127.12.202.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
I20260809 18:46:32.413574 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39661
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:35801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:32.495589 15423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:32.495784 15423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:32.495814 15423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:32.496999 15423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:32.497042 15423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:32.497063 15423 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:46:32.497081 15423 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:46:32.498605 15423 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:35801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.202.254:39661
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15423
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:32.498854 15423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:32.499074 15423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:32.504083 15437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:32.504140 15439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:32.504067 15433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:32.504367 15423 server_base.cc:1034] running on GCE node
I20260809 18:46:32.504565 15423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:32.504755 15423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:32.505923 15423 hybrid_clock.cc:648] HybridClock initialized: now 1786301192505910 us; error 29 us; skew 500 ppm
Aug 09 18:46:32 dist-test-slave-45dx krb5kdc[14775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301192, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:32.508607 15423 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:46:32.509065 15423 webserver.cc:460] Webserver started at http://127.12.202.195:46177/ using document root <none> and password file <none>
I20260809 18:46:32.509321 15423 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:32.509374 15423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:32.509534 15423 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:32.510576 15423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "fc063147c70d413db2692c8b68be1cb6"
format_stamp: "Formatted at 2026-08-09 18:46:32 on dist-test-slave-45dx"
server_key: "8abbb2fa66fbdbba3469d80bef101056"
server_key_iv: "9054a76e346b65c92d0921dbb305897e"
server_key_version: "encryptionkey@0"
I20260809 18:46:32.510939 15423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "fc063147c70d413db2692c8b68be1cb6"
format_stamp: "Formatted at 2026-08-09 18:46:32 on dist-test-slave-45dx"
server_key: "8abbb2fa66fbdbba3469d80bef101056"
server_key_iv: "9054a76e346b65c92d0921dbb305897e"
server_key_version: "encryptionkey@0"
I20260809 18:46:32.512297 15423 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:46:32.513162 15450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:32.513357 15423 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:32.513433 15423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "fc063147c70d413db2692c8b68be1cb6"
format_stamp: "Formatted at 2026-08-09 18:46:32 on dist-test-slave-45dx"
server_key: "8abbb2fa66fbdbba3469d80bef101056"
server_key_iv: "9054a76e346b65c92d0921dbb305897e"
server_key_version: "encryptionkey@0"
I20260809 18:46:32.513487 15423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:32.528605 15423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:32.531134 15423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:32.531255 15423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:32.531807 15423 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:32.531853 15423 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:32.531879 15423 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:32.531927 15423 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 18:46:32 dist-test-slave-45dx krb5kdc[14775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301192, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:32.539744 15423 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:38469
I20260809 18:46:32.539894 15649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:38469 every 8 connection(s)
I20260809 18:46:32.540174 15423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:46:32.542371 14926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.532226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:39555 (local address 127.12.202.254:39661)
0809 18:46:32.532271 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:32.532274 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:32.532532 (+ 258us) server_negotiation.cc:407] Connection header received
0809 18:46:32.533098 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:32.533100 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:32.533115 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:32.533175 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:32.534180 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.534683 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.536382 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.536589 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.536682 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.539530 (+ 2848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:32.539532 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:32.539532 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:32.539541 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:32.541209 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:32.541581 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:32.541582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:32.541582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:32.541637 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:32.541882 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:32.541883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:32.541883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:32.541984 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:32.542035 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:32.542249 (+ 214us) server_negotiation.cc:299] Negotiation successful
0809 18:46:32.542308 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 18:46:32.542583 15467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.532214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:39661 (local address 127.12.202.195:39555)
0809 18:46:32.532408 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:32.532444 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:32.532975 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:32.533304 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:32.533310 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:32.533732 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:32.534060 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.534068 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.534774 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.534775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.536260 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.536264 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.536705 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.536707 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.536894 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.537517 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:32.537529 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:32.539425 (+ 1896us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:32.541286 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:32.541291 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:32.541293 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:32.541514 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:32.541696 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:32.541697 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:32.541697 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:32.541818 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:32.542041 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:32.542046 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:32.542157 (+ 111us) client_negotiation.cc:769] Sending connection context
0809 18:46:32.542236 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 18:46:32.542357 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":120,"threads_started":1}
I20260809 18:46:32.543080 15651 heartbeater.cc:347] Connected to a master server at 127.12.202.254:39661
I20260809 18:46:32.543166 15651 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:32.543360 15651 heartbeater.cc:511] Master 127.12.202.254:39661 requested a full tablet report, sending...
I20260809 18:46:32.543722 14841 ts_manager.cc:194] Registered new tserver with Master: fc063147c70d413db2692c8b68be1cb6 (127.12.202.195:38469)
I20260809 18:46:32.544236 14841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:39555
I20260809 18:46:32.548703 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 15423
I20260809 18:46:32.548799 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:46:32.548990 13099 external_mini_cluster.cc:1428] Setting key a09198d04cd1f1901e43f221c53a3a7c
I20260809 18:46:32.549669 15661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.544116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:39661 (local address 127.12.202.195:35757)
0809 18:46:32.544260 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:32.544272 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:32.544389 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:32.544512 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:32.544513 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:32.544724 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:32.544801 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.544803 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.545441 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.545441 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.545911 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.545913 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.546216 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.546216 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.546270 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.546625 (+ 355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:32.546629 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:32.546887 (+ 258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:32.548453 (+ 1566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:32.548454 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:32.548454 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:32.548676 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:32.548910 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:32.548911 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:32.548911 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:32.548979 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:32.549294 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:32.549296 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:32.549343 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 18:46:32.549444 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 18:46:32.549560 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":88,"threads_started":1}
I20260809 18:46:32.549674 14926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.544202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:35757 (local address 127.12.202.254:39661)
0809 18:46:32.544247 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:32.544249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:32.544354 (+ 105us) server_negotiation.cc:407] Connection header received
0809 18:46:32.544440 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:32.544441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:32.544451 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:32.544506 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:32.544887 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.545338 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.545983 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.546153 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.546200 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.546964 (+ 764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:32.546965 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:32.546965 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:32.546971 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:32.548388 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:32.548752 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:32.548752 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:32.548753 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:32.548838 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:32.549067 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:32.549068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:32.549068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:32.549220 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:32.549299 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:32.549485 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 18:46:32.549583 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 18:46:32.549978 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 18:46:32 dist-test-slave-45dx krb5kdc[14775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301192, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 18:46:32 dist-test-slave-45dx krb5kdc[14775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301192, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:32.573988 14926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.567352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34074 (local address 127.12.202.254:39661)
0809 18:46:32.567417 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:32.567419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:32.567429 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:46:32.567463 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:32.567464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:32.567473 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:32.567525 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:32.568053 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.568590 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.569272 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.569454 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.569502 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.571605 (+ 2103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:32.571607 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:32.571607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:32.571614 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:32.573039 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:32.573358 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:32.573358 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:32.573359 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:32.573412 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:32.573579 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:32.573580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:32.573580 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:32.573674 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:32.573750 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:32.573841 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 18:46:32.573897 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:46:32.575515 14841 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34074:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:46:32.577258 14841 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:46:32.583806 15678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.579408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:43033 (local address 127.0.0.1:50552)
0809 18:46:32.579738 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:32.579750 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:32.579802 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:32.580199 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:32.580200 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:32.580203 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:32.580261 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.580263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.581327 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.581328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.582617 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.582620 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.583484 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.583485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.583578 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.583594 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 18:46:32.583660 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 18:46:32.583718 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":91,"threads_started":1}
I20260809 18:46:32.583870 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.579730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50552 (local address 127.12.202.193:43033)
0809 18:46:32.580012 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:32.580015 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:32.580023 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:46:32.580056 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:32.580058 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:32.580091 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:32.580181 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:32.580419 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.581237 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.582707 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.583397 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.583486 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.583544 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:32.583709 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 18:46:32.583763 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":99,"threads_started":1}
I20260809 18:46:32.584045 15681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.579516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43706 (local address 127.12.202.194:34243)
0809 18:46:32.579944 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:32.579948 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:32.579958 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:46:32.580007 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:32.580008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:32.580021 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:32.580086 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:32.580292 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.581489 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.582780 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.583478 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.583592 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.583648 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:32.583855 (+ 207us) server_negotiation.cc:299] Negotiation successful
0809 18:46:32.583916 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":91,"threads_started":1}
I20260809 18:46:32.583807 15679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.579401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:34243 (local address 127.0.0.1:43706)
0809 18:46:32.579550 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:32.579591 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:32.579661 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:32.580118 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:32.580122 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:32.580124 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:32.580204 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.580224 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.581577 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.581578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.582660 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.582663 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.583593 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.583594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.583657 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.583661 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:46:32.583709 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 18:46:32.583738 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":53,"threads_started":1}
I20260809 18:46:32.584511 15688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.579733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43670 (local address 127.12.202.195:38469)
0809 18:46:32.579920 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:32.579925 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:32.580261 (+ 336us) server_negotiation.cc:407] Connection header received
0809 18:46:32.580427 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:32.580429 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:32.580446 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:32.580504 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:32.580734 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.581743 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.582980 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.583703 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.583770 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.583815 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:32.584375 (+ 560us) server_negotiation.cc:299] Negotiation successful
0809 18:46:32.584423 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":117,"threads_started":1}
I20260809 18:46:32.584633 15683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.579605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:38469 (local address 127.0.0.1:43670)
0809 18:46:32.580188 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:32.580198 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:32.580290 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:32.580601 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:32.580601 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:32.580603 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:32.580648 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.580650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.581831 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.581832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.582883 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.582886 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.583866 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.583867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.583928 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.583933 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:46:32.583983 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 18:46:32.584021 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":72,"threads_started":1}
I20260809 18:46:32.584863 15063 tablet_service.cc:1467] Processing CreateTablet for tablet d372873fe2ea40cf84b84a6c37941a69 (DEFAULT_TABLE table=test-table [id=caa364028bd04b7ab5eb2e4056e92e74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:32.585258 15063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d372873fe2ea40cf84b84a6c37941a69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:32.585261 15541 tablet_service.cc:1467] Processing CreateTablet for tablet d372873fe2ea40cf84b84a6c37941a69 (DEFAULT_TABLE table=test-table [id=caa364028bd04b7ab5eb2e4056e92e74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:32.585623 15541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d372873fe2ea40cf84b84a6c37941a69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:32.588370 15690 tablet_bootstrap.cc:492] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7: Bootstrap starting.
I20260809 18:46:32.588383 15689 tablet_bootstrap.cc:492] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6: Bootstrap starting.
I20260809 18:46:32.589022 15690 tablet_bootstrap.cc:654] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:32.589084 15285 tablet_service.cc:1467] Processing CreateTablet for tablet d372873fe2ea40cf84b84a6c37941a69 (DEFAULT_TABLE table=test-table [id=caa364028bd04b7ab5eb2e4056e92e74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:32.589383 15690 log.cc:824] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:32.589428 15689 tablet_bootstrap.cc:654] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:32.589447 15285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d372873fe2ea40cf84b84a6c37941a69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:32.589745 15689 log.cc:824] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:32.590224 15690 tablet_bootstrap.cc:492] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7: No bootstrap required, opened a new log
I20260809 18:46:32.590296 15690 ts_tablet_manager.cc:1397] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:46:32.590538 15689 tablet_bootstrap.cc:492] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6: No bootstrap required, opened a new log
I20260809 18:46:32.590616 15689 ts_tablet_manager.cc:1397] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:46:32.591959 15690 raft_consensus.cc:348] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.592121 15690 raft_consensus.cc:374] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:32.592167 15690 raft_consensus.cc:729] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e6a88a0d72405096fc50671e4b1ed7, State: Initialized, Role: FOLLOWER
I20260809 18:46:32.592329 15690 consensus_queue.cc:260] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.592626 15690 ts_tablet_manager.cc:1428] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 18:46:32.592674 15160 heartbeater.cc:503] Master 127.12.202.254:39661 was elected leader, sending a full tablet report...
I20260809 18:46:32.592940 15689 raft_consensus.cc:348] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.593098 15689 raft_consensus.cc:374] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:32.593202 15689 raft_consensus.cc:729] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc063147c70d413db2692c8b68be1cb6, State: Initialized, Role: FOLLOWER
I20260809 18:46:32.593343 15689 consensus_queue.cc:260] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.593545 15696 tablet_bootstrap.cc:492] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1: Bootstrap starting.
I20260809 18:46:32.593614 15689 ts_tablet_manager.cc:1428] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:46:32.593636 15651 heartbeater.cc:503] Master 127.12.202.254:39661 was elected leader, sending a full tablet report...
I20260809 18:46:32.594336 15696 tablet_bootstrap.cc:654] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:32.594645 15696 log.cc:824] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:32.595265 15696 tablet_bootstrap.cc:492] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1: No bootstrap required, opened a new log
I20260809 18:46:32.595346 15696 ts_tablet_manager.cc:1397] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:46:32.596879 15696 raft_consensus.cc:348] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.597023 15696 raft_consensus.cc:374] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:32.597069 15696 raft_consensus.cc:729] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 432ed58c18124ed886d5753858bf60f1, State: Initialized, Role: FOLLOWER
I20260809 18:46:32.597198 15696 consensus_queue.cc:260] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.597430 15696 ts_tablet_manager.cc:1428] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:46:32.597484 15408 heartbeater.cc:503] Master 127.12.202.254:39661 was elected leader, sending a full tablet report...
W20260809 18:46:32.629140 15410 tablet.cc:2369] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:46:32.700862 15694 raft_consensus.cc:482] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:46:32.700979 15694 raft_consensus.cc:504] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.701359 15694 leader_election.cc:288] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 432ed58c18124ed886d5753858bf60f1 (127.12.202.194:34243), fc063147c70d413db2692c8b68be1cb6 (127.12.202.195:38469)
I20260809 18:46:32.705385 15681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.701654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:47123 (local address 127.12.202.194:34243)
0809 18:46:32.701715 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:32.701718 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:32.701728 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:46:32.701772 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:32.701773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:32.701783 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:32.701856 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:32.702040 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.702856 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.704432 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.705001 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.705078 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.705087 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:32.705269 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 18:46:32.705315 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 18:46:32.705392 15688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.701906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:47669 (local address 127.12.202.195:38469)
0809 18:46:32.701948 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:32.701950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:32.701988 (+ 38us) server_negotiation.cc:407] Connection header received
0809 18:46:32.702074 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:32.702075 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:32.702084 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:32.702140 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:32.702288 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.703005 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.704423 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.704993 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.705078 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.705087 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:32.705269 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 18:46:32.705313 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:46:32.705382 14998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.701554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:34243 (local address 127.12.202.193:47123)
0809 18:46:32.701638 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:32.701650 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:32.701697 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:32.701876 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:32.701877 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:32.701879 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:32.701961 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.701963 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.702982 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.702984 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.704286 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.704290 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.705086 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.705087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.705193 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.705195 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:46:32.705250 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 18:46:32.705281 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":5}
I20260809 18:46:32.705408 15700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.701700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:38469 (local address 127.12.202.193:47669)
0809 18:46:32.701934 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:32.701945 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:32.702000 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:32.702152 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:32.702153 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:32.702154 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:32.702207 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.702208 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.703068 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.703069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.704287 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.704290 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.705086 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.705087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.705168 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.705173 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:46:32.705237 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 18:46:32.705277 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":61,"thread_start_us":161,"threads_started":1}
I20260809 18:46:32.705811 15578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d372873fe2ea40cf84b84a6c37941a69" candidate_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc063147c70d413db2692c8b68be1cb6" is_pre_election: true
I20260809 18:46:32.705830 15327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d372873fe2ea40cf84b84a6c37941a69" candidate_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "432ed58c18124ed886d5753858bf60f1" is_pre_election: true
I20260809 18:46:32.705969 15578 raft_consensus.cc:2454] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5e6a88a0d72405096fc50671e4b1ed7 in term 0.
I20260809 18:46:32.706007 15327 raft_consensus.cc:2454] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5e6a88a0d72405096fc50671e4b1ed7 in term 0.
I20260809 18:46:32.706218 14987 leader_election.cc:302] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5e6a88a0d72405096fc50671e4b1ed7, fc063147c70d413db2692c8b68be1cb6; no voters:
I20260809 18:46:32.706391 15694 raft_consensus.cc:2781] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:46:32.706477 15694 raft_consensus.cc:482] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:46:32.706496 15694 raft_consensus.cc:3037] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:32.707237 15694 raft_consensus.cc:504] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.707376 15694 leader_election.cc:288] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [CANDIDATE]: Term 1 election: Requested vote from peers 432ed58c18124ed886d5753858bf60f1 (127.12.202.194:34243), fc063147c70d413db2692c8b68be1cb6 (127.12.202.195:38469)
I20260809 18:46:32.707535 15327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d372873fe2ea40cf84b84a6c37941a69" candidate_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "432ed58c18124ed886d5753858bf60f1"
I20260809 18:46:32.707593 15578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d372873fe2ea40cf84b84a6c37941a69" candidate_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc063147c70d413db2692c8b68be1cb6"
I20260809 18:46:32.707621 15327 raft_consensus.cc:3037] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:32.707659 15578 raft_consensus.cc:3037] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:32.708570 15327 raft_consensus.cc:2454] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e6a88a0d72405096fc50671e4b1ed7 in term 1.
I20260809 18:46:32.708570 15578 raft_consensus.cc:2454] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5e6a88a0d72405096fc50671e4b1ed7 in term 1.
I20260809 18:46:32.708763 14987 leader_election.cc:302] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5e6a88a0d72405096fc50671e4b1ed7, fc063147c70d413db2692c8b68be1cb6; no voters:
I20260809 18:46:32.708858 15694 raft_consensus.cc:2781] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:32.709010 15694 raft_consensus.cc:686] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [term 1 LEADER]: Becoming Leader. State: Replica: e5e6a88a0d72405096fc50671e4b1ed7, State: Running, Role: LEADER
I20260809 18:46:32.709131 15694 consensus_queue.cc:237] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.710052 14841 catalog_manager.cc:5495] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5e6a88a0d72405096fc50671e4b1ed7 (127.12.202.193). New cstate: current_term: 1 leader_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } health_report { overall_health: UNKNOWN } } }
W20260809 18:46:32.720281 15161 tablet.cc:2369] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:46:32.728217 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.726003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50558 (local address 127.12.202.193:43033)
0809 18:46:32.726043 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:32.726045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:32.726068 (+ 23us) server_negotiation.cc:407] Connection header received
0809 18:46:32.726164 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:32.726165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:32.726180 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:32.726232 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:46:32.726350 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.726812 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.727531 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.727709 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.727781 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.727946 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:46:32.728029 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:46:32.728084 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:32.728131 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 18:46:32.728148 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 18:46:32.730075 15578 raft_consensus.cc:1261] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6 [term 1 FOLLOWER]: Refusing update from remote peer e5e6a88a0d72405096fc50671e4b1ed7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:32.730086 15327 raft_consensus.cc:1261] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1 [term 1 FOLLOWER]: Refusing update from remote peer e5e6a88a0d72405096fc50671e4b1ed7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:32.730394 15694 consensus_queue.cc:1035] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:32.730538 15701 consensus_queue.cc:1035] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:32.736754 14841 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:46:32.736874 14841 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:46:32.737674 14841 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7: Sending DeleteTablet for 3 replicas of tablet d372873fe2ea40cf84b84a6c37941a69
I20260809 18:46:32.738003 15063 tablet_service.cc:1514] Processing DeleteTablet for tablet d372873fe2ea40cf84b84a6c37941a69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:32 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:50552
I20260809 18:46:32.738049 15541 tablet_service.cc:1514] Processing DeleteTablet for tablet d372873fe2ea40cf84b84a6c37941a69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:32 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:43670
I20260809 18:46:32.738091 15285 tablet_service.cc:1514] Processing DeleteTablet for tablet d372873fe2ea40cf84b84a6c37941a69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:32 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:43706
I20260809 18:46:32.738231 15723 tablet_replica.cc:330] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7: stopping tablet replica
I20260809 18:46:32.738325 15723 raft_consensus.cc:2229] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:46:32.738428 15723 raft_consensus.cc:2258] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:32.738521 15724 tablet_replica.cc:330] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6: stopping tablet replica
I20260809 18:46:32.738567 14841 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34074:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 18:46:32.738636 15725 tablet_replica.cc:330] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1: stopping tablet replica
W20260809 18:46:32.738723 14841 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:46:32.738914 15723 ts_tablet_manager.cc:1905] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:32.738925 15724 raft_consensus.cc:2229] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:46:32.739092 15725 raft_consensus.cc:2229] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:46:32.739270 15724 raft_consensus.cc:2258] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:32.739694 15725 raft_consensus.cc:2258] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:32.739873 15063 tablet_service.cc:1467] Processing CreateTablet for tablet 93af9a29e77a46f59b7cddf576a00cd7 (DEFAULT_TABLE table=test-table [id=add3b78468ce4f4ea7a119eb5bf0d0b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:32.740025 15063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93af9a29e77a46f59b7cddf576a00cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:32.740295 15724 ts_tablet_manager.cc:1905] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:32.741020 15723 ts_tablet_manager.cc:1918] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:46:32.741111 15723 log.cc:1196] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/wal/wals/d372873fe2ea40cf84b84a6c37941a69
I20260809 18:46:32.741400 15690 tablet_bootstrap.cc:492] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7: Bootstrap starting.
I20260809 18:46:32.741773 15725 ts_tablet_manager.cc:1905] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:32.741876 15690 tablet_bootstrap.cc:654] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:32.742604 15541 tablet_service.cc:1467] Processing CreateTablet for tablet 93af9a29e77a46f59b7cddf576a00cd7 (DEFAULT_TABLE table=test-table [id=add3b78468ce4f4ea7a119eb5bf0d0b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:32.742738 15541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93af9a29e77a46f59b7cddf576a00cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:32.743124 15724 ts_tablet_manager.cc:1918] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:46:32.743237 15724 log.cc:1196] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/d372873fe2ea40cf84b84a6c37941a69
I20260809 18:46:32.743567 15724 ts_tablet_manager.cc:1939] T d372873fe2ea40cf84b84a6c37941a69 P fc063147c70d413db2692c8b68be1cb6: Deleting consensus metadata
I20260809 18:46:32.743649 15725 ts_tablet_manager.cc:1918] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:46:32.743722 15725 log.cc:1196] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/d372873fe2ea40cf84b84a6c37941a69
I20260809 18:46:32.744024 15689 tablet_bootstrap.cc:492] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6: Bootstrap starting.
I20260809 18:46:32.744278 15285 tablet_service.cc:1467] Processing CreateTablet for tablet 93af9a29e77a46f59b7cddf576a00cd7 (DEFAULT_TABLE table=test-table [id=add3b78468ce4f4ea7a119eb5bf0d0b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:32.744424 15285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93af9a29e77a46f59b7cddf576a00cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:32.744503 15689 tablet_bootstrap.cc:654] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:32.744481 14822 catalog_manager.cc:4841] TS fc063147c70d413db2692c8b68be1cb6 (127.12.202.195:38469): tablet d372873fe2ea40cf84b84a6c37941a69 (table test-table [id=caa364028bd04b7ab5eb2e4056e92e74]) successfully deleted
I20260809 18:46:32.741427 15723 ts_tablet_manager.cc:1939] T d372873fe2ea40cf84b84a6c37941a69 P e5e6a88a0d72405096fc50671e4b1ed7: Deleting consensus metadata
I20260809 18:46:32.744808 15725 ts_tablet_manager.cc:1939] T d372873fe2ea40cf84b84a6c37941a69 P 432ed58c18124ed886d5753858bf60f1: Deleting consensus metadata
I20260809 18:46:32.745198 14825 catalog_manager.cc:4841] TS e5e6a88a0d72405096fc50671e4b1ed7 (127.12.202.193:43033): tablet d372873fe2ea40cf84b84a6c37941a69 (table test-table [id=caa364028bd04b7ab5eb2e4056e92e74]) successfully deleted
I20260809 18:46:32.745198 14822 catalog_manager.cc:4841] TS 432ed58c18124ed886d5753858bf60f1 (127.12.202.194:34243): tablet d372873fe2ea40cf84b84a6c37941a69 (table test-table [id=caa364028bd04b7ab5eb2e4056e92e74]) successfully deleted
I20260809 18:46:32.745568 15690 tablet_bootstrap.cc:492] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7: No bootstrap required, opened a new log
I20260809 18:46:32.745632 15690 ts_tablet_manager.cc:1397] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260809 18:46:32.745656 15696 tablet_bootstrap.cc:492] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1: Bootstrap starting.
I20260809 18:46:32.745772 15690 raft_consensus.cc:348] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.745882 15690 raft_consensus.cc:374] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:32.745906 15690 raft_consensus.cc:729] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e6a88a0d72405096fc50671e4b1ed7, State: Initialized, Role: FOLLOWER
I20260809 18:46:32.745949 15690 consensus_queue.cc:260] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.746053 15696 tablet_bootstrap.cc:654] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:32.746058 15690 ts_tablet_manager.cc:1428] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:32.746376 15689 tablet_bootstrap.cc:492] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6: No bootstrap required, opened a new log
I20260809 18:46:32.746421 15689 ts_tablet_manager.cc:1397] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 18:46:32.746578 15689 raft_consensus.cc:348] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.746671 15689 raft_consensus.cc:374] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:32.746701 15689 raft_consensus.cc:729] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc063147c70d413db2692c8b68be1cb6, State: Initialized, Role: FOLLOWER
I20260809 18:46:32.746747 15689 consensus_queue.cc:260] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.746876 15689 ts_tablet_manager.cc:1428] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 18:46:32.746909 15696 tablet_bootstrap.cc:492] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1: No bootstrap required, opened a new log
I20260809 18:46:32.746950 15696 ts_tablet_manager.cc:1397] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:32.747097 15696 raft_consensus.cc:348] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.747161 15696 raft_consensus.cc:374] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:32.747175 15696 raft_consensus.cc:729] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 432ed58c18124ed886d5753858bf60f1, State: Initialized, Role: FOLLOWER
I20260809 18:46:32.747233 15696 consensus_queue.cc:260] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.747335 15696 ts_tablet_manager.cc:1428] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260809 18:46:32.790823 15652 tablet.cc:2369] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:46:32.799636 15697 raft_consensus.cc:482] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:46:32.799741 15697 raft_consensus.cc:504] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.800094 15697 leader_election.cc:288] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5e6a88a0d72405096fc50671e4b1ed7 (127.12.202.193:43033), 432ed58c18124ed886d5753858bf60f1 (127.12.202.194:34243)
I20260809 18:46:32.803539 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.800337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:50231 (local address 127.12.202.193:43033)
0809 18:46:32.800396 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:32.800399 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:32.800521 (+ 122us) server_negotiation.cc:407] Connection header received
0809 18:46:32.800607 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:32.800608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:32.800619 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:32.800694 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:32.800933 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.801646 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.802736 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.803171 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.803239 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.803249 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:32.803412 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 18:46:32.803451 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 18:46:32.803553 15731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.800283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:43033 (local address 127.12.202.195:50231)
0809 18:46:32.800454 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:32.800465 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:32.800548 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:32.800732 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:32.800733 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:32.800734 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:32.800847 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.800848 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.801766 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.801767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.802663 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.802665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.803251 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.803253 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.803324 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.803329 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:46:32.803398 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 18:46:32.803437 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":23,"thread_start_us":86,"threads_started":1}
I20260809 18:46:32.804057 15467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.800261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:34243 (local address 127.12.202.195:49237)
0809 18:46:32.800393 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:32.800405 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:32.800447 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:32.800685 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:32.800686 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:32.800689 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:32.800778 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.800780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.801744 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.801746 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.803011 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.803014 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.803799 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.803801 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.803879 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.803882 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:46:32.803934 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 18:46:32.803971 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":27}
I20260809 18:46:32.804090 15681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.800513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:49237 (local address 127.12.202.194:34243)
0809 18:46:32.800565 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:32.800567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:32.800575 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:46:32.800603 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:32.800604 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:32.800613 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:32.800666 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:32.800853 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.801640 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.803105 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.803675 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.803753 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.803763 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:32.803970 (+ 207us) server_negotiation.cc:299] Negotiation successful
0809 18:46:32.804024 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 18:46:32.804184 15092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93af9a29e77a46f59b7cddf576a00cd7" candidate_uuid: "fc063147c70d413db2692c8b68be1cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" is_pre_election: true
I20260809 18:46:32.804350 15092 raft_consensus.cc:2454] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc063147c70d413db2692c8b68be1cb6 in term 0.
I20260809 18:46:32.804401 15327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93af9a29e77a46f59b7cddf576a00cd7" candidate_uuid: "fc063147c70d413db2692c8b68be1cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "432ed58c18124ed886d5753858bf60f1" is_pre_election: true
I20260809 18:46:32.804492 15327 raft_consensus.cc:2454] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc063147c70d413db2692c8b68be1cb6 in term 0.
I20260809 18:46:32.804533 15458 leader_election.cc:302] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5e6a88a0d72405096fc50671e4b1ed7, fc063147c70d413db2692c8b68be1cb6; no voters:
I20260809 18:46:32.804662 15697 raft_consensus.cc:2781] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:46:32.804699 15697 raft_consensus.cc:482] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:46:32.804726 15697 raft_consensus.cc:3037] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:32.805486 15697 raft_consensus.cc:504] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.805640 15697 leader_election.cc:288] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [CANDIDATE]: Term 1 election: Requested vote from peers e5e6a88a0d72405096fc50671e4b1ed7 (127.12.202.193:43033), 432ed58c18124ed886d5753858bf60f1 (127.12.202.194:34243)
I20260809 18:46:32.805792 15327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93af9a29e77a46f59b7cddf576a00cd7" candidate_uuid: "fc063147c70d413db2692c8b68be1cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "432ed58c18124ed886d5753858bf60f1"
I20260809 18:46:32.805878 15327 raft_consensus.cc:3037] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:32.805866 15092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93af9a29e77a46f59b7cddf576a00cd7" candidate_uuid: "fc063147c70d413db2692c8b68be1cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e6a88a0d72405096fc50671e4b1ed7"
I20260809 18:46:32.805929 15092 raft_consensus.cc:3037] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:32.806666 15327 raft_consensus.cc:2454] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc063147c70d413db2692c8b68be1cb6 in term 1.
I20260809 18:46:32.806666 15092 raft_consensus.cc:2454] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc063147c70d413db2692c8b68be1cb6 in term 1.
I20260809 18:46:32.806852 15451 leader_election.cc:302] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 432ed58c18124ed886d5753858bf60f1, fc063147c70d413db2692c8b68be1cb6; no voters:
I20260809 18:46:32.806968 15697 raft_consensus.cc:2781] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:32.807152 15697 raft_consensus.cc:686] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [term 1 LEADER]: Becoming Leader. State: Replica: fc063147c70d413db2692c8b68be1cb6, State: Running, Role: LEADER
I20260809 18:46:32.807230 15697 consensus_queue.cc:237] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.807914 14840 catalog_manager.cc:5495] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc063147c70d413db2692c8b68be1cb6 (127.12.202.195). New cstate: current_term: 1 leader_uuid: "fc063147c70d413db2692c8b68be1cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } health_report { overall_health: HEALTHY } } }
Aug 09 18:46:32 dist-test-slave-45dx krb5kdc[14775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301191, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:32.860268 15741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.853069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:39661 (local address 127.0.0.1:34084)
0809 18:46:32.853259 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:32.853274 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:32.853374 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:32.853538 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:32.853539 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:32.853929 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:32.853988 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.853991 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.854631 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.854633 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.855344 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:32.855346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.855711 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.855712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:32.855775 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.856361 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:32.856367 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:32.857800 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:32.859296 (+ 1496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:32.859303 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:32.859305 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:32.859543 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:32.859722 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:32.859723 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:32.859723 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:32.859783 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:32.859987 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:32.859994 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:32.860033 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 18:46:32.860086 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 18:46:32.860173 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":99,"threads_started":1}
I20260809 18:46:32.860388 14926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:32.853143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34084 (local address 127.12.202.254:39661)
0809 18:46:32.853210 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:32.853213 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:32.853352 (+ 139us) server_negotiation.cc:407] Connection header received
0809 18:46:32.853438 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:32.853439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:32.853449 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:32.853501 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:32.854063 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.854547 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.855438 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:32.855627 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:32.855683 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:32.857904 (+ 2221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:32.857905 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:32.857906 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:32.857914 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:32.859225 (+ 1311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:32.859607 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:32.859608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:32.859608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:32.859661 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:32.859833 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:32.859833 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:32.859834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:32.859933 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:32.859984 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:32.860115 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 18:46:32.860220 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":35}
I20260809 18:46:32.862286 14840 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:34084:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 18:46:32.862488 14840 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:46:32.863991 15063 tablet_service.cc:1467] Processing CreateTablet for tablet 8583eb34d0344d5fb59df92a1928bedf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ce9088b54c78452bab090de0eb951277]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:46:32.864046 15541 tablet_service.cc:1467] Processing CreateTablet for tablet 8583eb34d0344d5fb59df92a1928bedf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ce9088b54c78452bab090de0eb951277]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:46:32.864073 15285 tablet_service.cc:1467] Processing CreateTablet for tablet 8583eb34d0344d5fb59df92a1928bedf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ce9088b54c78452bab090de0eb951277]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:46:32.864183 15063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8583eb34d0344d5fb59df92a1928bedf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:32.864208 15285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8583eb34d0344d5fb59df92a1928bedf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:32.864208 15541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8583eb34d0344d5fb59df92a1928bedf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:32.865409 15690 tablet_bootstrap.cc:492] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7: Bootstrap starting.
I20260809 18:46:32.865742 15689 tablet_bootstrap.cc:492] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6: Bootstrap starting.
I20260809 18:46:32.865761 15690 tablet_bootstrap.cc:654] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:32.866165 15689 tablet_bootstrap.cc:654] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:32.866425 15690 tablet_bootstrap.cc:492] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7: No bootstrap required, opened a new log
I20260809 18:46:32.866469 15690 ts_tablet_manager.cc:1397] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:32.866583 15690 raft_consensus.cc:348] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.866622 15696 tablet_bootstrap.cc:492] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1: Bootstrap starting.
I20260809 18:46:32.866669 15690 raft_consensus.cc:374] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:32.866693 15690 raft_consensus.cc:729] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e6a88a0d72405096fc50671e4b1ed7, State: Initialized, Role: FOLLOWER
I20260809 18:46:32.866741 15690 consensus_queue.cc:260] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.866861 15690 ts_tablet_manager.cc:1428] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:32.866915 15717 tablet_replica.cc:439] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } } }
I20260809 18:46:32.867024 15717 tablet_replica.cc:442] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:46:32.867044 15696 tablet_bootstrap.cc:654] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:32.867614 15689 tablet_bootstrap.cc:492] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6: No bootstrap required, opened a new log
I20260809 18:46:32.867666 15689 ts_tablet_manager.cc:1397] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 18:46:32.867815 15689 raft_consensus.cc:348] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.867892 15689 raft_consensus.cc:374] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:32.867926 15689 raft_consensus.cc:729] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc063147c70d413db2692c8b68be1cb6, State: Initialized, Role: FOLLOWER
I20260809 18:46:32.867977 15689 consensus_queue.cc:260] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.868065 15689 ts_tablet_manager.cc:1428] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:32.868114 15697 tablet_replica.cc:439] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } } }
I20260809 18:46:32.868232 15697 tablet_replica.cc:442] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:46:32.868299 15696 tablet_bootstrap.cc:492] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1: No bootstrap required, opened a new log
I20260809 18:46:32.868383 15696 ts_tablet_manager.cc:1397] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:46:32.868548 15696 raft_consensus.cc:348] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.868621 15696 raft_consensus.cc:374] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:32.868650 15696 raft_consensus.cc:729] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 432ed58c18124ed886d5753858bf60f1, State: Initialized, Role: FOLLOWER
I20260809 18:46:32.868695 15696 consensus_queue.cc:260] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.868788 15696 ts_tablet_manager.cc:1428] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:32.868942 15699 tablet_replica.cc:439] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } } }
I20260809 18:46:32.869029 15699 tablet_replica.cc:442] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:46:32.985450 15697 raft_consensus.cc:482] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:46:32.985549 15697 raft_consensus.cc:504] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.985976 15092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8583eb34d0344d5fb59df92a1928bedf" candidate_uuid: "fc063147c70d413db2692c8b68be1cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" is_pre_election: true
I20260809 18:46:32.986117 15092 raft_consensus.cc:2454] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc063147c70d413db2692c8b68be1cb6 in term 0.
I20260809 18:46:32.986125 15697 leader_election.cc:288] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5e6a88a0d72405096fc50671e4b1ed7 (127.12.202.193:43033), 432ed58c18124ed886d5753858bf60f1 (127.12.202.194:34243)
I20260809 18:46:32.986280 15458 leader_election.cc:302] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5e6a88a0d72405096fc50671e4b1ed7, fc063147c70d413db2692c8b68be1cb6; no voters:
I20260809 18:46:32.986346 15327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8583eb34d0344d5fb59df92a1928bedf" candidate_uuid: "fc063147c70d413db2692c8b68be1cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "432ed58c18124ed886d5753858bf60f1" is_pre_election: true
I20260809 18:46:32.986423 15697 raft_consensus.cc:2781] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:46:32.986482 15697 raft_consensus.cc:482] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:46:32.986476 15327 raft_consensus.cc:2454] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc063147c70d413db2692c8b68be1cb6 in term 0.
I20260809 18:46:32.986516 15697 raft_consensus.cc:3037] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:32.987243 15697 raft_consensus.cc:504] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.987426 15697 leader_election.cc:288] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [CANDIDATE]: Term 1 election: Requested vote from peers e5e6a88a0d72405096fc50671e4b1ed7 (127.12.202.193:43033), 432ed58c18124ed886d5753858bf60f1 (127.12.202.194:34243)
I20260809 18:46:32.987589 15327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8583eb34d0344d5fb59df92a1928bedf" candidate_uuid: "fc063147c70d413db2692c8b68be1cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "432ed58c18124ed886d5753858bf60f1"
I20260809 18:46:32.987588 15092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8583eb34d0344d5fb59df92a1928bedf" candidate_uuid: "fc063147c70d413db2692c8b68be1cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5e6a88a0d72405096fc50671e4b1ed7"
I20260809 18:46:32.987668 15327 raft_consensus.cc:3037] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:32.987668 15092 raft_consensus.cc:3037] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:32.988492 15327 raft_consensus.cc:2454] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc063147c70d413db2692c8b68be1cb6 in term 1.
I20260809 18:46:32.988588 15092 raft_consensus.cc:2454] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc063147c70d413db2692c8b68be1cb6 in term 1.
I20260809 18:46:32.988721 15451 leader_election.cc:302] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 432ed58c18124ed886d5753858bf60f1, fc063147c70d413db2692c8b68be1cb6; no voters:
I20260809 18:46:32.988832 15697 raft_consensus.cc:2781] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:32.989054 15697 raft_consensus.cc:686] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [term 1 LEADER]: Becoming Leader. State: Replica: fc063147c70d413db2692c8b68be1cb6, State: Running, Role: LEADER
I20260809 18:46:32.989159 15697 consensus_queue.cc:237] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } }
I20260809 18:46:32.989581 15732 tablet_replica.cc:439] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6: TxnStatusTablet state changed. Reason: New leader fc063147c70d413db2692c8b68be1cb6. Latest consensus state: current_term: 1 leader_uuid: "fc063147c70d413db2692c8b68be1cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } } }
I20260809 18:46:32.989676 15732 tablet_replica.cc:442] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:46:32.989920 15749 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 18:46:32.989946 14840 catalog_manager.cc:5495] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc063147c70d413db2692c8b68be1cb6 (127.12.202.195). New cstate: current_term: 1 leader_uuid: "fc063147c70d413db2692c8b68be1cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } health_report { overall_health: HEALTHY } } }
I20260809 18:46:32.990072 15749 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 18:46:33.016767 15688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:33.014035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43674 (local address 127.12.202.195:38469)
0809 18:46:33.014097 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:33.014100 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:33.014118 (+ 18us) server_negotiation.cc:407] Connection header received
0809 18:46:33.014160 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:33.014161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:33.014187 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:33.014260 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:46:33.014421 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:33.014901 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:33.015825 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:33.016047 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:33.016137 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:33.016410 (+ 273us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:46:33.016510 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:46:33.016595 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:33.016655 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 18:46:33.016681 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 18:46:33.016772 15741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:33.013945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:38469 (local address 127.0.0.1:43674)
0809 18:46:33.014018 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:33.014031 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:33.014083 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:33.014264 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:33.014265 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:33.014266 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:46:33.014328 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:33.014331 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:33.014987 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:33.014989 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:33.015663 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:33.015666 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:33.016122 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:33.016124 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:33.016197 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:33.016236 (+ 39us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:46:33.016579 (+ 343us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:46:33.016590 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 18:46:33.016648 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 18:46:33.016701 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 18:46:33.018321 15327 raft_consensus.cc:1261] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1 [term 1 FOLLOWER]: Refusing update from remote peer fc063147c70d413db2692c8b68be1cb6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:33.018410 15092 raft_consensus.cc:1261] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7 [term 1 FOLLOWER]: Refusing update from remote peer fc063147c70d413db2692c8b68be1cb6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:33.018719 15732 consensus_queue.cc:1035] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:33.018890 15697 consensus_queue.cc:1035] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:33.019506 15699 tablet_replica.cc:439] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1: TxnStatusTablet state changed. Reason: New leader fc063147c70d413db2692c8b68be1cb6. Latest consensus state: current_term: 1 leader_uuid: "fc063147c70d413db2692c8b68be1cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } } }
I20260809 18:46:33.019603 15699 tablet_replica.cc:442] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:46:33.019562 15717 tablet_replica.cc:439] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7: TxnStatusTablet state changed. Reason: New leader fc063147c70d413db2692c8b68be1cb6. Latest consensus state: current_term: 1 leader_uuid: "fc063147c70d413db2692c8b68be1cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } } }
I20260809 18:46:33.019650 15717 tablet_replica.cc:442] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:46:33.020358 15712 mvcc.cc:205] Tried to move back new op lower bound from 7316689686600749056 to 7316689686484213760. Current Snapshot: MvccSnapshot[applied={T|T < 7316689686600749056}]
I20260809 18:46:33.020506 15697 tablet_replica.cc:439] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fc063147c70d413db2692c8b68be1cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } } }
I20260809 18:46:33.020571 15697 tablet_replica.cc:442] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:46:33.020807 15699 tablet_replica.cc:439] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fc063147c70d413db2692c8b68be1cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } } }
I20260809 18:46:33.020910 15699 tablet_replica.cc:442] T 8583eb34d0344d5fb59df92a1928bedf P 432ed58c18124ed886d5753858bf60f1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:46:33.020972 15710 mvcc.cc:205] Tried to move back new op lower bound from 7316689686600749056 to 7316689686484213760. Current Snapshot: MvccSnapshot[applied={T|T < 7316689686600749056 or (T in {7316689686600749056})}]
I20260809 18:46:33.021268 15697 tablet_replica.cc:439] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fc063147c70d413db2692c8b68be1cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } } }
I20260809 18:46:33.021347 15697 tablet_replica.cc:442] T 8583eb34d0344d5fb59df92a1928bedf P fc063147c70d413db2692c8b68be1cb6: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:46:33.021929 15709 mvcc.cc:205] Tried to move back new op lower bound from 7316689686600749056 to 7316689686484213760. Current Snapshot: MvccSnapshot[applied={T|T < 7316689686600749056}]
I20260809 18:46:33.022022 15717 tablet_replica.cc:439] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fc063147c70d413db2692c8b68be1cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 } } peers { permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 } } peers { permanent_uuid: "fc063147c70d413db2692c8b68be1cb6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 38469 } } }
I20260809 18:46:33.022092 15717 tablet_replica.cc:442] T 8583eb34d0344d5fb59df92a1928bedf P e5e6a88a0d72405096fc50671e4b1ed7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:46:33.025821 15688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:33.023229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43684 (local address 127.12.202.195:38469)
0809 18:46:33.023268 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:33.023270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:33.023340 (+ 70us) server_negotiation.cc:407] Connection header received
0809 18:46:33.023410 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:33.023411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:33.023421 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:33.023478 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:46:33.023555 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:33.024404 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:33.025115 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:33.025404 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:33.025476 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:33.025583 (+ 107us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:46:33.025614 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:46:33.025681 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:33.025729 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 18:46:33.025749 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 18:46:33.030712 15661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:33.028190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:38469 (local address 127.12.202.195:33961)
0809 18:46:33.028263 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:33.028275 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:33.028332 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:33.028474 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:33.028475 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:33.028476 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:46:33.028524 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:33.028524 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:33.029326 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:33.029326 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:33.029864 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:33.029865 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:33.030289 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:33.030290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:33.030337 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:33.030350 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:46:33.030536 (+ 186us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:46:33.030538 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:46:33.030572 (+ 34us) client_negotiation.cc:240] Negotiation successful
0809 18:46:33.030624 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 18:46:33.030718 15688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:33.028266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:33961 (local address 127.12.202.195:38469)
0809 18:46:33.028320 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:33.028322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:33.028331 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:46:33.028399 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:33.028399 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:33.028409 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:33.028466 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:46:33.028584 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:33.029249 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:33.029936 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:33.030218 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:33.030284 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:33.030434 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:46:33.030463 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:46:33.030513 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:33.030575 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 18:46:33.030611 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 18:46:33.033313 15092 raft_consensus.cc:1261] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7 [term 1 FOLLOWER]: Refusing update from remote peer fc063147c70d413db2692c8b68be1cb6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:33.033310 15327 raft_consensus.cc:1261] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1 [term 1 FOLLOWER]: Refusing update from remote peer fc063147c70d413db2692c8b68be1cb6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:33.033542 15757 consensus_queue.cc:1035] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5e6a88a0d72405096fc50671e4b1ed7" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 43033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:33.033743 15697 consensus_queue.cc:1035] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "432ed58c18124ed886d5753858bf60f1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:33.052345 14841 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:46:33.052474 14841 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:46:33.053121 14841 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3e7a258166da48d9947d3df2fcd200a7: Sending DeleteTablet for 3 replicas of tablet 93af9a29e77a46f59b7cddf576a00cd7
I20260809 18:46:33.053432 15285 tablet_service.cc:1514] Processing DeleteTablet for tablet 93af9a29e77a46f59b7cddf576a00cd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:33 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:43706
I20260809 18:46:33.053455 15541 tablet_service.cc:1514] Processing DeleteTablet for tablet 93af9a29e77a46f59b7cddf576a00cd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:33 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:43670
I20260809 18:46:33.053545 15063 tablet_service.cc:1514] Processing DeleteTablet for tablet 93af9a29e77a46f59b7cddf576a00cd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:33 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:50552
I20260809 18:46:33.053643 15725 tablet_replica.cc:330] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1: stopping tablet replica
I20260809 18:46:33.053663 15723 tablet_replica.cc:330] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7: stopping tablet replica
I20260809 18:46:33.053691 15725 raft_consensus.cc:2229] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:46:33.053725 15725 raft_consensus.cc:2258] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:33.053728 15723 raft_consensus.cc:2229] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:46:33.053766 15723 raft_consensus.cc:2258] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:33.054088 15724 tablet_replica.cc:330] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6: stopping tablet replica
I20260809 18:46:33.054083 15723 ts_tablet_manager.cc:1905] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:33.054141 15724 raft_consensus.cc:2229] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:46:33.054219 15724 raft_consensus.cc:2258] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:33.055840 15724 ts_tablet_manager.cc:1905] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:33.056041 15725 ts_tablet_manager.cc:1905] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:33.057314 15723 ts_tablet_manager.cc:1918] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:46:33.057330 15725 ts_tablet_manager.cc:1918] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:46:33.057380 15725 log.cc:1196] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/93af9a29e77a46f59b7cddf576a00cd7
I20260809 18:46:33.057390 15723 log.cc:1196] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-0/wal/wals/93af9a29e77a46f59b7cddf576a00cd7
I20260809 18:46:33.057513 15724 ts_tablet_manager.cc:1918] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:46:33.057564 15724 log.cc:1196] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/93af9a29e77a46f59b7cddf576a00cd7
I20260809 18:46:33.057618 15725 ts_tablet_manager.cc:1939] T 93af9a29e77a46f59b7cddf576a00cd7 P 432ed58c18124ed886d5753858bf60f1: Deleting consensus metadata
I20260809 18:46:33.057649 15723 ts_tablet_manager.cc:1939] T 93af9a29e77a46f59b7cddf576a00cd7 P e5e6a88a0d72405096fc50671e4b1ed7: Deleting consensus metadata
I20260809 18:46:33.057780 15724 ts_tablet_manager.cc:1939] T 93af9a29e77a46f59b7cddf576a00cd7 P fc063147c70d413db2692c8b68be1cb6: Deleting consensus metadata
I20260809 18:46:33.058000 14825 catalog_manager.cc:4841] TS e5e6a88a0d72405096fc50671e4b1ed7 (127.12.202.193:43033): tablet 93af9a29e77a46f59b7cddf576a00cd7 (table test-table [id=add3b78468ce4f4ea7a119eb5bf0d0b3]) successfully deleted
I20260809 18:46:33.058017 14822 catalog_manager.cc:4841] TS 432ed58c18124ed886d5753858bf60f1 (127.12.202.194:34243): tablet 93af9a29e77a46f59b7cddf576a00cd7 (table test-table [id=add3b78468ce4f4ea7a119eb5bf0d0b3]) successfully deleted
I20260809 18:46:33.058552 14822 catalog_manager.cc:4841] TS fc063147c70d413db2692c8b68be1cb6 (127.12.202.195:38469): tablet 93af9a29e77a46f59b7cddf576a00cd7 (table test-table [id=add3b78468ce4f4ea7a119eb5bf0d0b3]) successfully deleted
Aug 09 18:46:33 dist-test-slave-45dx krb5kdc[14775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301192, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.202.193@KRBTEST.COM
I20260809 18:46:33.067634 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:33.055745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50560 (local address 127.12.202.193:43033)
0809 18:46:33.055814 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:33.055816 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:33.055827 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:46:33.055850 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:33.055851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:33.055861 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:33.055930 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:33.058714 (+ 2784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:33.059330 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:33.060439 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:33.060617 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:33.060669 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:33.063969 (+ 3300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:33.063978 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:33.063979 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:33.063993 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:33.065841 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:33.066757 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:33.066760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:33.066761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:33.066825 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:33.067052 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:33.067053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:33.067053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:33.067222 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:33.067372 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:33.067450 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 18:46:33.067530 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260809 18:46:33.067884 15151 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50560
I20260809 18:46:33.074787 14926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:33.068903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34088 (local address 127.12.202.254:39661)
0809 18:46:33.068952 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:33.068955 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:33.068964 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:46:33.069026 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:33.069027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:33.069036 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:33.069090 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:33.069591 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:33.070074 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:33.070704 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:33.070902 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:33.070969 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:33.072155 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:33.072157 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:33.072157 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:33.072166 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:33.073686 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:33.074018 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:33.074019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:33.074019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:33.074082 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:33.074297 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:33.074298 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:33.074299 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:33.074414 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:33.074513 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:33.074615 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 18:46:33.074689 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
W20260809 18:46:33.075217 14841 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34088
I20260809 18:46:33.076112 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 14962
I20260809 18:46:33.089268 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 15173
I20260809 18:46:33.105398 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 15423
I20260809 18:46:33.121582 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 14802
2026-08-09T18:46:33Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2607 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:46:33 dist-test-slave-45dx krb5kdc[15774](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:46:33 dist-test-slave-45dx krb5kdc[15774](info): set up 2 sockets
Aug 09 18:46:33 dist-test-slave-45dx krb5kdc[15774](info): commencing operation
krb5kdc: starting...
W20260809 18:46:34.375183 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:46:34 dist-test-slave-45dx krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:46:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:46:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:46:34.497169 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:36853
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:41117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:36853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:34.578960 15791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:34.579147 15791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:34.579169 15791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:34.580395 15791 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:46:34.580438 15791 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 18:46:34.580451 15791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:34.580466 15791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:34.580508 15791 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:46:34.580525 15791 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:46:34.582089 15791 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:41117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:36853
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:36853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:34.582340 15791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:34.582588 15791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:34.587673 15804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:34.587731 15798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:34.587759 15791 server_base.cc:1034] running on GCE node
W20260809 18:46:34.587731 15799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:34.588140 15791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:34.588481 15791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:34.589624 15791 hybrid_clock.cc:648] HybridClock initialized: now 1786301194589612 us; error 28 us; skew 500 ppm
Aug 09 18:46:34 dist-test-slave-45dx krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301194, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:34.592175 15791 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:46:34.592671 15791 webserver.cc:460] Webserver started at http://127.12.202.254:33055/ using document root <none> and password file <none>
I20260809 18:46:34.592942 15791 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:34.592988 15791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:34.593163 15791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:34.594188 15791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "b85b45d51c9340728d3255b7a239c2d6"
format_stamp: "Formatted at 2026-08-09 18:46:34 on dist-test-slave-45dx"
server_key: "1ccbcf2120a6896c7451a145f4291deb"
server_key_iv: "83255dc1bc3bdaa16d187cbd795e35bb"
server_key_version: "encryptionkey@0"
I20260809 18:46:34.594545 15791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "b85b45d51c9340728d3255b7a239c2d6"
format_stamp: "Formatted at 2026-08-09 18:46:34 on dist-test-slave-45dx"
server_key: "1ccbcf2120a6896c7451a145f4291deb"
server_key_iv: "83255dc1bc3bdaa16d187cbd795e35bb"
server_key_version: "encryptionkey@0"
I20260809 18:46:34.595865 15791 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:46:34.596716 15819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:34.596935 15791 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:46:34.597030 15791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "b85b45d51c9340728d3255b7a239c2d6"
format_stamp: "Formatted at 2026-08-09 18:46:34 on dist-test-slave-45dx"
server_key: "1ccbcf2120a6896c7451a145f4291deb"
server_key_iv: "83255dc1bc3bdaa16d187cbd795e35bb"
server_key_version: "encryptionkey@0"
I20260809 18:46:34.597114 15791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:34.605917 15791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:34.607671 15791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:34.607836 15791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:34.612774 15791 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:36853
I20260809 18:46:34.612839 15923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:36853 every 8 connection(s)
I20260809 18:46:34.613135 15791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:46:34.613734 15924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:34.615993 15924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6: Bootstrap starting.
I20260809 18:46:34.616663 15924 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:34.616963 15924 log.cc:824] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:34.617640 15924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6: No bootstrap required, opened a new log
I20260809 18:46:34.619766 15924 raft_consensus.cc:348] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b85b45d51c9340728d3255b7a239c2d6" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36853 } }
I20260809 18:46:34.619935 15924 raft_consensus.cc:374] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:34.619987 15924 raft_consensus.cc:729] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85b45d51c9340728d3255b7a239c2d6, State: Initialized, Role: FOLLOWER
I20260809 18:46:34.620167 15924 consensus_queue.cc:260] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b85b45d51c9340728d3255b7a239c2d6" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36853 } }
I20260809 18:46:34.620272 15924 raft_consensus.cc:388] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:46:34.620342 15924 raft_consensus.cc:482] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:46:34.620397 15924 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:34.620932 15924 raft_consensus.cc:504] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b85b45d51c9340728d3255b7a239c2d6" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36853 } }
I20260809 18:46:34.621057 15924 leader_election.cc:302] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b85b45d51c9340728d3255b7a239c2d6; no voters:
I20260809 18:46:34.621413 15924 leader_election.cc:288] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:46:34.621438 15928 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:34.621560 15928 raft_consensus.cc:686] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6 [term 1 LEADER]: Becoming Leader. State: Replica: b85b45d51c9340728d3255b7a239c2d6, State: Running, Role: LEADER
I20260809 18:46:34.621656 15928 consensus_queue.cc:237] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b85b45d51c9340728d3255b7a239c2d6" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36853 } }
I20260809 18:46:34.621730 15924 sys_catalog.cc:564] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:34.621912 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 15791
I20260809 18:46:34.622002 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:46:34.622002 15928 sys_catalog.cc:455] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b85b45d51c9340728d3255b7a239c2d6. Latest consensus state: current_term: 1 leader_uuid: "b85b45d51c9340728d3255b7a239c2d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b85b45d51c9340728d3255b7a239c2d6" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36853 } } }
I20260809 18:46:34.622068 15928 sys_catalog.cc:458] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6 [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:34.622176 13099 external_mini_cluster.cc:1428] Setting key 36e1e50b0a8ca3465e7b8b6fde0337c1
I20260809 18:46:34.623158 15929 sys_catalog.cc:455] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b85b45d51c9340728d3255b7a239c2d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b85b45d51c9340728d3255b7a239c2d6" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36853 } } }
I20260809 18:46:34.623591 15929 sys_catalog.cc:458] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6 [sys.catalog]: This master's current role is: LEADER
W20260809 18:46:34.623602 15950 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:46:34.623693 15950 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:46:34.624135 15935 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:46:34.624356 15935 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:46:34.625905 15935 catalog_manager.cc:1347] Generated new cluster ID: d29534b444f84e36959216409161c084
I20260809 18:46:34.625962 15935 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:46:34 dist-test-slave-45dx krb5kdc[15774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:34.634665 15948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:34.622850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51918 (local address 127.12.202.254:36853)
0809 18:46:34.623101 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:34.623111 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:34.623448 (+ 337us) server_negotiation.cc:407] Connection header received
0809 18:46:34.623595 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:34.623603 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:34.623664 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:34.623803 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:34.624645 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:34.626084 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:34.627173 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:34.627795 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:34.627876 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:34.630821 (+ 2945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:34.630827 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:34.630827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:34.630842 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:34.632970 (+ 2128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:34.633358 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:34.633362 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:34.633362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:34.633492 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:34.633704 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:34.633705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:34.633706 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:34.634037 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:34.634213 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:34.634285 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 18:46:34.634430 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":123,"threads_started":1}
I20260809 18:46:34.636662 15935 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:46:34.637271 15935 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:46:34.640897 15935 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6: Generated new TSK 0
I20260809 18:46:34.641070 15935 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
I20260809 18:46:34.672958 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36853
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:41117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:34.756556 15958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:34.756771 15958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:34.756796 15958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:34.757970 15958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:34.758011 15958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:34.758033 15958 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 18:46:34.758044 15958 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:46:34.758062 15958 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:46:34.759505 15958 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:41117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.202.254:36853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:34.759701 15958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:34.759879 15958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:34.764837 15968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:34.764847 15964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:34.765086 15965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:34.765089 15958 server_base.cc:1034] running on GCE node
I20260809 18:46:34.765386 15958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:34.765636 15958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:34.766806 15958 hybrid_clock.cc:648] HybridClock initialized: now 1786301194766788 us; error 31 us; skew 500 ppm
Aug 09 18:46:34 dist-test-slave-45dx krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301194, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:34.769609 15958 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:46:34.770047 15958 webserver.cc:460] Webserver started at http://127.12.202.193:34647/ using document root <none> and password file <none>
I20260809 18:46:34.770282 15958 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:34.770327 15958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:34.770505 15958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:34.771517 15958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "ef44026ec6194fdbb019d29182ac646c"
format_stamp: "Formatted at 2026-08-09 18:46:34 on dist-test-slave-45dx"
server_key: "c91ee77d40b0e1b1cdbe04d3e2fe0498"
server_key_iv: "77567db1b4005c8915bd3a7da1f1d3df"
server_key_version: "encryptionkey@0"
I20260809 18:46:34.771884 15958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "ef44026ec6194fdbb019d29182ac646c"
format_stamp: "Formatted at 2026-08-09 18:46:34 on dist-test-slave-45dx"
server_key: "c91ee77d40b0e1b1cdbe04d3e2fe0498"
server_key_iv: "77567db1b4005c8915bd3a7da1f1d3df"
server_key_version: "encryptionkey@0"
I20260809 18:46:34.773319 15958 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:46:34.774072 15981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:34.774268 15958 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:34.774374 15958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "ef44026ec6194fdbb019d29182ac646c"
format_stamp: "Formatted at 2026-08-09 18:46:34 on dist-test-slave-45dx"
server_key: "c91ee77d40b0e1b1cdbe04d3e2fe0498"
server_key_iv: "77567db1b4005c8915bd3a7da1f1d3df"
server_key_version: "encryptionkey@0"
I20260809 18:46:34.774447 15958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:34.783504 15958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:34.785868 15958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:34.786024 15958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:34.786592 15958 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:34.786643 15958 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:34.786665 15958 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:34.786677 15958 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 18:46:34 dist-test-slave-45dx krb5kdc[15774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301194, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:34.793924 15958 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:45211
I20260809 18:46:34.794006 16158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:45211 every 8 connection(s)
I20260809 18:46:34.794332 15958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:46:34.796799 15948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:34.787003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:43309 (local address 127.12.202.254:36853)
0809 18:46:34.787052 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:34.787054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:34.787250 (+ 196us) server_negotiation.cc:407] Connection header received
0809 18:46:34.787771 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:34.787773 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:34.787786 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:34.787851 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:34.788658 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:34.789488 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:34.790569 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:34.790790 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:34.790886 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:34.793903 (+ 3017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:34.793904 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:34.793904 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:34.793915 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:34.795384 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:34.795793 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:34.795794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:34.795795 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:34.795860 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:34.796126 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:34.796127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:34.796127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:34.796249 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:34.796338 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:34.796629 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 18:46:34.796708 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:46:34.796989 15995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:34.786987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36853 (local address 127.12.202.193:43309)
0809 18:46:34.787130 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:34.787163 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:34.787659 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:34.787921 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:34.787927 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:34.788239 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:34.788553 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:34.788559 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:34.789586 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:34.789587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:34.790472 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:34.790474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:34.790906 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:34.790907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:34.791024 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:34.791516 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:34.791524 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:34.793796 (+ 2272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:34.795469 (+ 1673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:34.795477 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:34.795479 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:34.795704 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:34.795938 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:34.795939 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:34.795939 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:34.796049 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:34.796335 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:34.796343 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:34.796492 (+ 149us) client_negotiation.cc:769] Sending connection context
0809 18:46:34.796605 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 18:46:34.796760 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":85,"threads_started":1}
I20260809 18:46:34.797530 16159 heartbeater.cc:347] Connected to a master server at 127.12.202.254:36853
I20260809 18:46:34.797618 16159 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:34.797823 16159 heartbeater.cc:511] Master 127.12.202.254:36853 requested a full tablet report, sending...
I20260809 18:46:34.798382 15852 ts_manager.cc:194] Registered new tserver with Master: ef44026ec6194fdbb019d29182ac646c (127.12.202.193:45211)
I20260809 18:46:34.798653 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 15958
I20260809 18:46:34.798744 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:46:34.798925 13099 external_mini_cluster.cc:1428] Setting key e334cd576a9acb9be7942ef9c8d42eb2
I20260809 18:46:34.799268 15852 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:43309
I20260809 18:46:34.805368 16167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:34.798632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36853 (local address 127.12.202.193:59381)
0809 18:46:34.799151 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:34.799162 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:34.799227 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:34.799575 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:34.799576 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:34.799790 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:34.799859 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:34.799861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:34.800602 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:34.800602 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:34.801450 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:34.801455 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:34.801839 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:34.801840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:34.801926 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:34.802347 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:34.802352 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:34.802617 (+ 265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:34.804417 (+ 1800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:34.804418 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:34.804418 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:34.804587 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:34.804795 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:34.804796 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:34.804796 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:34.804863 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:34.805142 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:34.805143 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:34.805179 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 18:46:34.805229 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 18:46:34.805302 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":83,"threads_started":1}
I20260809 18:46:34.805480 15948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:34.798701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:59381 (local address 127.12.202.254:36853)
0809 18:46:34.799090 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:34.799092 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:34.799407 (+ 315us) server_negotiation.cc:407] Connection header received
0809 18:46:34.799429 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:34.799430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:34.799441 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:34.799490 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:34.799950 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:34.800478 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:34.801554 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:34.801766 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:34.801840 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:34.802701 (+ 861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:34.802703 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:34.802703 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:34.802711 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:34.804291 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:34.804662 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:34.804663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:34.804663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:34.804725 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:34.804928 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:34.804929 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:34.804929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:34.805073 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:34.805150 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:34.805259 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 18:46:34.805342 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366}
WARNING: no policy specified for kudu/127.12.202.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
I20260809 18:46:34.825201 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36853
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:41117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:34.907326 16172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:34.907578 16172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:34.907620 16172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:34.908809 16172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:34.908885 16172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:34.908924 16172 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 18:46:34.908972 16172 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:46:34.909006 16172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:46:34.910512 16172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:41117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.202.254:36853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:34.910792 16172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:34.911033 16172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:34.916240 16183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:34.916218 16180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:34.916272 16179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:34.916390 16172 server_base.cc:1034] running on GCE node
I20260809 18:46:34.916605 16172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:34.916836 16172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:34.917997 16172 hybrid_clock.cc:648] HybridClock initialized: now 1786301194917987 us; error 28 us; skew 500 ppm
Aug 09 18:46:34 dist-test-slave-45dx krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301194, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:34.920567 16172 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:46:34.921056 16172 webserver.cc:460] Webserver started at http://127.12.202.194:37387/ using document root <none> and password file <none>
I20260809 18:46:34.921296 16172 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:34.921342 16172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:34.921478 16172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:34.922690 16172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "08101e55a83b4b83bfa6a419d44ad340"
format_stamp: "Formatted at 2026-08-09 18:46:34 on dist-test-slave-45dx"
server_key: "71bc7cea0b2e3d15675807c82b0c6db3"
server_key_iv: "aa26d87733e8ac80a3afd1e033f1d81c"
server_key_version: "encryptionkey@0"
I20260809 18:46:34.923142 16172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "08101e55a83b4b83bfa6a419d44ad340"
format_stamp: "Formatted at 2026-08-09 18:46:34 on dist-test-slave-45dx"
server_key: "71bc7cea0b2e3d15675807c82b0c6db3"
server_key_iv: "aa26d87733e8ac80a3afd1e033f1d81c"
server_key_version: "encryptionkey@0"
I20260809 18:46:34.924775 16172 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260809 18:46:34.925544 16191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:34.925722 16172 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:34.925808 16172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "08101e55a83b4b83bfa6a419d44ad340"
format_stamp: "Formatted at 2026-08-09 18:46:34 on dist-test-slave-45dx"
server_key: "71bc7cea0b2e3d15675807c82b0c6db3"
server_key_iv: "aa26d87733e8ac80a3afd1e033f1d81c"
server_key_version: "encryptionkey@0"
I20260809 18:46:34.925877 16172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:34.936723 16172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:34.939009 16172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:34.939123 16172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:34.939554 16172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:34.939591 16172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:34.939648 16172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:34.939682 16172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:34.946347 16172 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:43371
I20260809 18:46:34.946434 16376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:43371 every 8 connection(s)
I20260809 18:46:34.946732 16172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
Aug 09 18:46:34 dist-test-slave-45dx krb5kdc[15774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301194, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:34.949774 15948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:34.940088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:60233 (local address 127.12.202.254:36853)
0809 18:46:34.940168 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:34.940171 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:34.940364 (+ 193us) server_negotiation.cc:407] Connection header received
0809 18:46:34.940887 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:34.940889 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:34.940905 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:34.940991 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:34.941880 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:34.942716 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:34.944368 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:34.944699 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:34.944788 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:34.947343 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:34.947344 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:34.947344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:34.947355 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:34.948602 (+ 1247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:34.948973 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:34.948973 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:34.948974 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:34.949023 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:34.949238 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:34.949238 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:34.949239 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:34.949336 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:34.949393 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:34.949649 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 18:46:34.949711 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 18:46:34.949757 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 16172
I20260809 18:46:34.949896 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:46:34.950052 16205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:34.940013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36853 (local address 127.12.202.194:60233)
0809 18:46:34.940193 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:34.940234 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:34.940788 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:34.941075 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:34.941079 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:34.941452 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:34.941766 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:34.941772 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:34.942826 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:34.942827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:34.944224 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:34.944228 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:34.944797 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:34.944799 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:34.944904 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:34.945449 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:34.945459 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:34.947239 (+ 1780us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:34.948672 (+ 1433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:34.948679 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:34.948681 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:34.948907 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:34.949088 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:34.949088 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:34.949089 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:34.949184 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:34.949401 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:34.949405 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:34.949508 (+ 103us) client_negotiation.cc:769] Sending connection context
0809 18:46:34.949628 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 18:46:34.949800 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":93,"threads_started":1}
I20260809 18:46:34.950074 13099 external_mini_cluster.cc:1428] Setting key 5b9656c02104173f4d722de201264799
I20260809 18:46:34.950596 16377 heartbeater.cc:347] Connected to a master server at 127.12.202.254:36853
I20260809 18:46:34.950682 16377 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:34.950865 16377 heartbeater.cc:511] Master 127.12.202.254:36853 requested a full tablet report, sending...
I20260809 18:46:34.951210 15855 ts_manager.cc:194] Registered new tserver with Master: 08101e55a83b4b83bfa6a419d44ad340 (127.12.202.194:43371)
I20260809 18:46:34.951717 15855 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:60233
I20260809 18:46:34.957589 16383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:34.951678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36853 (local address 127.12.202.194:55929)
0809 18:46:34.951881 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:34.951895 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:34.951960 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:34.952088 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:34.952089 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:34.952326 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:34.952409 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:34.952411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:34.953065 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:34.953066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:34.953546 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:34.953548 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:34.954004 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:34.954004 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:34.954062 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:34.954491 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:34.954496 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:34.954760 (+ 264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:34.956573 (+ 1813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:34.956574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:34.956574 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:34.956742 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:34.956962 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:34.956963 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:34.956963 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:34.957017 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:34.957367 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:34.957368 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:34.957403 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 18:46:34.957453 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 18:46:34.957528 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":106,"threads_started":1}
I20260809 18:46:34.957698 15948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:34.951680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:55929 (local address 127.12.202.254:36853)
0809 18:46:34.951719 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:34.951720 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:34.951948 (+ 228us) server_negotiation.cc:407] Connection header received
0809 18:46:34.952008 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:34.952008 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:34.952018 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:34.952077 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:34.952495 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:34.952975 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:34.953634 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:34.953928 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:34.953999 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:34.954850 (+ 851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:34.954852 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:34.954852 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:34.954860 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:34.956476 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:34.956816 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:34.956817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:34.956818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:34.956891 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:34.957082 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:34.957083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:34.957084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:34.957289 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:34.957371 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:34.957485 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 18:46:34.957566 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
WARNING: no policy specified for kudu/127.12.202.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
I20260809 18:46:34.979540 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36853
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:41117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:35.061663 16386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:35.061897 16386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:35.061923 16386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:35.063023 16386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:35.063055 16386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:35.063074 16386 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 18:46:35.063084 16386 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:46:35.063099 16386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:46:35.064469 16386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:41117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.202.254:36853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:35.064656 16386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:35.064818 16386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:35.069759 16392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:35.069811 16393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:35.069918 16386 server_base.cc:1034] running on GCE node
W20260809 18:46:35.069768 16396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:35.070186 16386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:35.070464 16386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:35.071619 16386 hybrid_clock.cc:648] HybridClock initialized: now 1786301195071605 us; error 47 us; skew 500 ppm
Aug 09 18:46:35 dist-test-slave-45dx krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301195, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:35.074294 16386 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:46:35.074774 16386 webserver.cc:460] Webserver started at http://127.12.202.195:41669/ using document root <none> and password file <none>
I20260809 18:46:35.075035 16386 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:35.075106 16386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:35.075254 16386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:35.076349 16386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "07d6ceec6c2647b6a52af46655263830"
format_stamp: "Formatted at 2026-08-09 18:46:35 on dist-test-slave-45dx"
server_key: "b157fd96d4fb169b628ef170aa80498c"
server_key_iv: "b4a2f4acc5ac37c56c211170d91ac7f9"
server_key_version: "encryptionkey@0"
I20260809 18:46:35.076735 16386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "07d6ceec6c2647b6a52af46655263830"
format_stamp: "Formatted at 2026-08-09 18:46:35 on dist-test-slave-45dx"
server_key: "b157fd96d4fb169b628ef170aa80498c"
server_key_iv: "b4a2f4acc5ac37c56c211170d91ac7f9"
server_key_version: "encryptionkey@0"
I20260809 18:46:35.078156 16386 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 18:46:35.079049 16414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:35.079246 16386 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:46:35.079353 16386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "07d6ceec6c2647b6a52af46655263830"
format_stamp: "Formatted at 2026-08-09 18:46:35 on dist-test-slave-45dx"
server_key: "b157fd96d4fb169b628ef170aa80498c"
server_key_iv: "b4a2f4acc5ac37c56c211170d91ac7f9"
server_key_version: "encryptionkey@0"
I20260809 18:46:35.079432 16386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:35.106293 16386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:35.108158 16386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:35.108402 16386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:35.109041 16386 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:35.109097 16386 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:35.109129 16386 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:35.109156 16386 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 18:46:35 dist-test-slave-45dx krb5kdc[15774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301195, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:35.116917 16386 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:35061
I20260809 18:46:35.117008 16589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:35061 every 8 connection(s)
I20260809 18:46:35.117305 16386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:46:35.119726 15948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.109470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:42591 (local address 127.12.202.254:36853)
0809 18:46:35.109541 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:35.109543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:35.109809 (+ 266us) server_negotiation.cc:407] Connection header received
0809 18:46:35.110588 (+ 779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:35.110589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:35.110599 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:35.110681 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:35.111635 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.112437 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.114051 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.114272 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.114366 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.116932 (+ 2566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:35.116933 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:35.116933 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:35.116944 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:35.118547 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:35.118920 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:35.118920 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:35.118921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:35.118974 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:35.119200 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:35.119200 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:35.119200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:35.119318 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:35.119368 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:35.119596 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 18:46:35.119665 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 18:46:35.119858 16429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.109443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36853 (local address 127.12.202.195:42591)
0809 18:46:35.109645 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:35.109701 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:35.110461 (+ 760us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:35.110774 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:35.110779 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:35.111189 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:35.111518 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.111526 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.112541 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.112542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.113925 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.113929 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.114398 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.114400 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.114559 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.115151 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:35.115161 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:35.116811 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:35.118617 (+ 1806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:35.118624 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:35.118625 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:35.118850 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:35.119036 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:35.119037 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:35.119037 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:35.119146 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:35.119377 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:35.119382 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:35.119488 (+ 106us) client_negotiation.cc:769] Sending connection context
0809 18:46:35.119565 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 18:46:35.119680 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":103,"threads_started":1}
I20260809 18:46:35.120329 16590 heartbeater.cc:347] Connected to a master server at 127.12.202.254:36853
I20260809 18:46:35.120450 16590 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:35.120620 16590 heartbeater.cc:511] Master 127.12.202.254:36853 requested a full tablet report, sending...
I20260809 18:46:35.121055 15849 ts_manager.cc:194] Registered new tserver with Master: 07d6ceec6c2647b6a52af46655263830 (127.12.202.195:35061)
I20260809 18:46:35.121611 15849 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:42591
I20260809 18:46:35.125617 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 16386
I20260809 18:46:35.125733 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:46:35.125975 13099 external_mini_cluster.cc:1428] Setting key 9b7dd7bcfed13cb148a4db5a80aa63a6
I20260809 18:46:35.127077 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:46:35.127820 15948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.121477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:44679 (local address 127.12.202.254:36853)
0809 18:46:35.121523 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:35.121525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:35.121683 (+ 158us) server_negotiation.cc:407] Connection header received
0809 18:46:35.121805 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:35.121806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:35.121816 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:35.121865 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:35.122449 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.122899 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.123761 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.123947 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.124006 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.124926 (+ 920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:35.124926 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:35.124927 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:35.124932 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:35.126660 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:35.127080 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:35.127081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:35.127082 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:35.127145 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:35.127349 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:35.127350 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:35.127351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:35.127468 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:35.127525 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:35.127701 (+ 176us) server_negotiation.cc:299] Negotiation successful
0809 18:46:35.127762 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:46:35.127923 16599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.121419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36853 (local address 127.12.202.195:44679)
0809 18:46:35.121606 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:35.121618 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:35.121698 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:35.122005 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:35.122006 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:35.122211 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:35.122291 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.122293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.123033 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.123034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.123647 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.123649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.124020 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.124020 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.124075 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.124566 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:35.124570 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:35.124841 (+ 271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:35.126764 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:35.126765 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:35.126765 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:35.127003 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:35.127224 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:35.127225 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:35.127226 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:35.127287 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:35.127541 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:35.127542 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:35.127597 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 18:46:35.127674 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 18:46:35.127780 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":96,"threads_started":1}
Aug 09 18:46:35 dist-test-slave-45dx krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 18:46:35 dist-test-slave-45dx krb5kdc[15774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:35.150835 15948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.144340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51920 (local address 127.12.202.254:36853)
0809 18:46:35.144385 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:35.144387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:35.144403 (+ 16us) server_negotiation.cc:407] Connection header received
0809 18:46:35.144440 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:35.144441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:35.144450 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:35.144502 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:35.145027 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.145494 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.146167 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.146342 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.146398 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.148522 (+ 2124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:35.148523 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:35.148523 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:35.148530 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:35.149926 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:35.150213 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:35.150213 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:35.150214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:35.150265 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:35.150414 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:35.150414 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:35.150414 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:35.150502 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:35.150573 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:35.150716 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 18:46:35.150772 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 18:46:35.152664 15849 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51920:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:46:35.154279 15849 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:46:35.160643 16618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.156981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:45211 (local address 127.0.0.1:41960)
0809 18:46:35.157136 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:35.157147 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:35.157204 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:35.157497 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:35.157498 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:35.157500 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:35.157537 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.157538 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.158408 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.158410 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.159563 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.159566 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.160331 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.160332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.160417 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.160432 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 18:46:35.160510 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 18:46:35.160572 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":101,"threads_started":1}
I20260809 18:46:35.160897 16625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.156741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:35061 (local address 127.0.0.1:42016)
0809 18:46:35.157124 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:35.157134 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:35.157177 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:35.157532 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:35.157533 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:35.157535 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:35.157583 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.157585 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.158844 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.158845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.159585 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.159587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.160671 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.160672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.160734 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.160738 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:46:35.160792 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 18:46:35.160828 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":8,"thread_start_us":69,"threads_started":1}
I20260809 18:46:35.160953 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.156799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42016 (local address 127.12.202.195:35061)
0809 18:46:35.157301 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:35.157304 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:35.157313 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:46:35.157353 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:35.157355 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:35.157371 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:35.157456 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:35.157663 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.158774 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.159711 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.160518 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.160582 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.160635 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:35.160812 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 18:46:35.160854 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":99,"threads_started":1}
I20260809 18:46:35.160684 16620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.156800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41960 (local address 127.12.202.193:45211)
0809 18:46:35.157174 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:35.157179 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:35.157192 (+ 13us) server_negotiation.cc:407] Connection header received
0809 18:46:35.157314 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:35.157316 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:35.157331 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:35.157394 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:35.157600 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.158302 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.159667 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.160216 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.160293 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.160382 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:35.160535 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 18:46:35.160577 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":96,"threads_started":1}
I20260809 18:46:35.161708 16489 tablet_service.cc:1467] Processing CreateTablet for tablet 6ae6bedc5a5e49979184aa3dd84cd70f (DEFAULT_TABLE table=test-table [id=65deb53752b14b65aa3f45f5dff9cb3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:35.161916 16619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.156668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:43371 (local address 127.0.0.1:42528)
0809 18:46:35.156870 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:35.156912 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:35.156978 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:35.157343 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:35.157346 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:35.157348 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:35.157431 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.157433 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.158788 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.158789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.160115 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.160118 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.161318 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.161319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.161400 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.161404 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:46:35.161807 (+ 403us) client_negotiation.cc:240] Negotiation successful
0809 18:46:35.161849 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":52,"threads_started":1}
I20260809 18:46:35.161981 16062 tablet_service.cc:1467] Processing CreateTablet for tablet 6ae6bedc5a5e49979184aa3dd84cd70f (DEFAULT_TABLE table=test-table [id=65deb53752b14b65aa3f45f5dff9cb3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:35.162202 16489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ae6bedc5a5e49979184aa3dd84cd70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:35.162364 16062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ae6bedc5a5e49979184aa3dd84cd70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:35.164819 16626 tablet_bootstrap.cc:492] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830: Bootstrap starting.
I20260809 18:46:35.165360 16627 tablet_bootstrap.cc:492] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c: Bootstrap starting.
I20260809 18:46:35.165704 16623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.156944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42528 (local address 127.12.202.194:43371)
0809 18:46:35.157150 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:35.157156 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:35.157168 (+ 12us) server_negotiation.cc:407] Connection header received
0809 18:46:35.157208 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:35.157211 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:35.157228 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:35.157509 (+ 281us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:35.157569 (+ 60us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.158694 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.160206 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.160969 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.161299 (+ 330us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.161371 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:35.165559 (+ 4188us) server_negotiation.cc:299] Negotiation successful
0809 18:46:35.165604 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":99,"threads_started":1}
I20260809 18:46:35.165871 16626 tablet_bootstrap.cc:654] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:35.165987 16627 tablet_bootstrap.cc:654] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:35.166230 16626 log.cc:824] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:35.166334 16627 log.cc:824] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:35.166363 16273 tablet_service.cc:1467] Processing CreateTablet for tablet 6ae6bedc5a5e49979184aa3dd84cd70f (DEFAULT_TABLE table=test-table [id=65deb53752b14b65aa3f45f5dff9cb3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:35.166704 16273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ae6bedc5a5e49979184aa3dd84cd70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:35.167060 16626 tablet_bootstrap.cc:492] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830: No bootstrap required, opened a new log
I20260809 18:46:35.167137 16626 ts_tablet_manager.cc:1397] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:46:35.168856 16627 tablet_bootstrap.cc:492] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c: No bootstrap required, opened a new log
I20260809 18:46:35.168941 16627 ts_tablet_manager.cc:1397] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260809 18:46:35.169236 16626 raft_consensus.cc:348] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } }
I20260809 18:46:35.169431 16626 raft_consensus.cc:374] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:35.169482 16626 raft_consensus.cc:729] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d6ceec6c2647b6a52af46655263830, State: Initialized, Role: FOLLOWER
I20260809 18:46:35.169620 16626 consensus_queue.cc:260] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } }
I20260809 18:46:35.169920 16626 ts_tablet_manager.cc:1428] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:46:35.169968 16590 heartbeater.cc:503] Master 127.12.202.254:36853 was elected leader, sending a full tablet report...
I20260809 18:46:35.170830 16636 tablet_bootstrap.cc:492] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340: Bootstrap starting.
I20260809 18:46:35.170883 16627 raft_consensus.cc:348] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } }
I20260809 18:46:35.171057 16627 raft_consensus.cc:374] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:35.171092 16627 raft_consensus.cc:729] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef44026ec6194fdbb019d29182ac646c, State: Initialized, Role: FOLLOWER
I20260809 18:46:35.171197 16627 consensus_queue.cc:260] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } }
I20260809 18:46:35.171458 16627 ts_tablet_manager.cc:1428] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 18:46:35.171525 16636 tablet_bootstrap.cc:654] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:35.171535 16159 heartbeater.cc:503] Master 127.12.202.254:36853 was elected leader, sending a full tablet report...
I20260809 18:46:35.171873 16636 log.cc:824] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:35.172624 16636 tablet_bootstrap.cc:492] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340: No bootstrap required, opened a new log
I20260809 18:46:35.172678 16636 ts_tablet_manager.cc:1397] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:46:35.174001 16636 raft_consensus.cc:348] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } }
I20260809 18:46:35.174119 16636 raft_consensus.cc:374] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:35.174140 16636 raft_consensus.cc:729] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08101e55a83b4b83bfa6a419d44ad340, State: Initialized, Role: FOLLOWER
I20260809 18:46:35.174275 16636 consensus_queue.cc:260] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } }
I20260809 18:46:35.174566 16636 ts_tablet_manager.cc:1428] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:46:35.174587 16377 heartbeater.cc:503] Master 127.12.202.254:36853 was elected leader, sending a full tablet report...
W20260809 18:46:35.197402 16378 tablet.cc:2369] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:46:35.253803 16640 raft_consensus.cc:482] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:46:35.253948 16640 raft_consensus.cc:504] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } }
I20260809 18:46:35.254359 16640 leader_election.cc:288] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07d6ceec6c2647b6a52af46655263830 (127.12.202.195:35061), ef44026ec6194fdbb019d29182ac646c (127.12.202.193:45211)
I20260809 18:46:35.257258 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.254642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:52675 (local address 127.12.202.195:35061)
0809 18:46:35.254701 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:35.254703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:35.254712 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:46:35.254764 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:35.254765 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:35.254774 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:35.254852 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:35.255011 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.255470 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.256461 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.256892 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.256979 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.256989 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:35.257154 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 18:46:35.257189 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 18:46:35.257347 16620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.254670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:52901 (local address 127.12.202.193:45211)
0809 18:46:35.254727 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:35.254729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:35.254866 (+ 137us) server_negotiation.cc:407] Connection header received
0809 18:46:35.254918 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:35.254919 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:35.254935 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:35.254998 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:35.255155 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.255594 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.256561 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.256991 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.257080 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.257088 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:35.257239 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 18:46:35.257276 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 18:46:35.257381 16641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.254568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:45211 (local address 127.12.202.194:52901)
0809 18:46:35.254767 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:35.254781 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:35.254859 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:35.255001 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:35.255002 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:35.255004 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:35.255083 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.255085 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.255677 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.255678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.256454 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.256456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.257080 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.257081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.257160 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.257163 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:46:35.257233 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 18:46:35.257274 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":13,"thread_start_us":114,"threads_started":1}
I20260809 18:46:35.257259 16205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.254568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:35061 (local address 127.12.202.194:52675)
0809 18:46:35.254636 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:35.254650 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:35.254709 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:35.254856 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:35.254857 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:35.254859 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:35.254938 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.254939 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.255553 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.255555 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.256311 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.256361 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.256978 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.256979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.257074 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.257078 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:46:35.257148 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 18:46:35.257188 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":27}
I20260809 18:46:35.257733 16091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ae6bedc5a5e49979184aa3dd84cd70f" candidate_uuid: "08101e55a83b4b83bfa6a419d44ad340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef44026ec6194fdbb019d29182ac646c" is_pre_election: true
I20260809 18:46:35.257799 16524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ae6bedc5a5e49979184aa3dd84cd70f" candidate_uuid: "08101e55a83b4b83bfa6a419d44ad340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d6ceec6c2647b6a52af46655263830" is_pre_election: true
I20260809 18:46:35.257896 16091 raft_consensus.cc:2454] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08101e55a83b4b83bfa6a419d44ad340 in term 0.
I20260809 18:46:35.257929 16524 raft_consensus.cc:2454] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08101e55a83b4b83bfa6a419d44ad340 in term 0.
I20260809 18:46:35.258121 16198 leader_election.cc:302] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08101e55a83b4b83bfa6a419d44ad340, ef44026ec6194fdbb019d29182ac646c; no voters:
I20260809 18:46:35.258252 16640 raft_consensus.cc:2781] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:46:35.258311 16640 raft_consensus.cc:482] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:46:35.258339 16640 raft_consensus.cc:3037] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:35.259339 16640 raft_consensus.cc:504] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } }
I20260809 18:46:35.259486 16640 leader_election.cc:288] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [CANDIDATE]: Term 1 election: Requested vote from peers 07d6ceec6c2647b6a52af46655263830 (127.12.202.195:35061), ef44026ec6194fdbb019d29182ac646c (127.12.202.193:45211)
I20260809 18:46:35.259613 16524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ae6bedc5a5e49979184aa3dd84cd70f" candidate_uuid: "08101e55a83b4b83bfa6a419d44ad340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d6ceec6c2647b6a52af46655263830"
I20260809 18:46:35.259645 16091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ae6bedc5a5e49979184aa3dd84cd70f" candidate_uuid: "08101e55a83b4b83bfa6a419d44ad340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef44026ec6194fdbb019d29182ac646c"
I20260809 18:46:35.259696 16524 raft_consensus.cc:3037] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:35.259744 16091 raft_consensus.cc:3037] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:35.260510 16524 raft_consensus.cc:2454] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08101e55a83b4b83bfa6a419d44ad340 in term 1.
I20260809 18:46:35.260571 16091 raft_consensus.cc:2454] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08101e55a83b4b83bfa6a419d44ad340 in term 1.
I20260809 18:46:35.260713 16193 leader_election.cc:302] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d6ceec6c2647b6a52af46655263830, 08101e55a83b4b83bfa6a419d44ad340; no voters:
I20260809 18:46:35.260833 16640 raft_consensus.cc:2781] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:35.260993 16640 raft_consensus.cc:686] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [term 1 LEADER]: Becoming Leader. State: Replica: 08101e55a83b4b83bfa6a419d44ad340, State: Running, Role: LEADER
I20260809 18:46:35.261107 16640 consensus_queue.cc:237] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } }
I20260809 18:46:35.262593 15855 catalog_manager.cc:5495] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08101e55a83b4b83bfa6a419d44ad340 (127.12.202.194). New cstate: current_term: 1 leader_uuid: "08101e55a83b4b83bfa6a419d44ad340" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } health_report { overall_health: UNKNOWN } } }
W20260809 18:46:35.295900 16160 tablet.cc:2369] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 18:46:35 dist-test-slave-45dx krb5kdc[15774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301194, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:35.302374 16655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.293198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36853 (local address 127.0.0.1:51922)
0809 18:46:35.293339 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:35.293351 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:35.293448 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:35.293581 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:35.293582 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:35.293999 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:35.294059 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.294062 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.294826 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.294827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.295564 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.295566 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.296019 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.296020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.296069 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.297721 (+ 1652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:35.297726 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:35.299364 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:35.301169 (+ 1805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:35.301178 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:35.301180 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:35.301375 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:35.301591 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:35.301592 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:35.301592 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:35.301648 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:35.301959 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:35.301967 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:35.302030 (+ 63us) client_negotiation.cc:769] Sending connection context
0809 18:46:35.302113 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 18:46:35.302258 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":79,"threads_started":1}
I20260809 18:46:35.302536 15948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.293235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51922 (local address 127.12.202.254:36853)
0809 18:46:35.293285 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:35.293288 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:35.293427 (+ 139us) server_negotiation.cc:407] Connection header received
0809 18:46:35.293503 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:35.293504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:35.293515 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:35.293579 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:35.294142 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.294760 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.295630 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.295886 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.295931 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.299446 (+ 3515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:35.299448 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:35.299448 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:35.299456 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:35.301070 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:35.301462 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:35.301464 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:35.301465 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:35.301518 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:35.301717 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:35.301718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:35.301718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:35.301878 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:35.301955 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:35.302158 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 18:46:35.302365 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":92,"server-negotiator.queue_time_us":21}
I20260809 18:46:35.304649 15855 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:51922:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 18:46:35.304865 15855 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:46:35.306242 16062 tablet_service.cc:1467] Processing CreateTablet for tablet 49db0bfd9a224e2389f9f0edadf4417c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=64a9c743b9a8434996afcb838f1c972f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:46:35.306246 16273 tablet_service.cc:1467] Processing CreateTablet for tablet 49db0bfd9a224e2389f9f0edadf4417c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=64a9c743b9a8434996afcb838f1c972f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:46:35.306452 16062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49db0bfd9a224e2389f9f0edadf4417c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:35.306468 16273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49db0bfd9a224e2389f9f0edadf4417c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:35.307606 16627 tablet_bootstrap.cc:492] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c: Bootstrap starting.
I20260809 18:46:35.307758 16489 tablet_service.cc:1467] Processing CreateTablet for tablet 49db0bfd9a224e2389f9f0edadf4417c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=64a9c743b9a8434996afcb838f1c972f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:46:35.307922 16489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49db0bfd9a224e2389f9f0edadf4417c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:35.308037 16627 tablet_bootstrap.cc:654] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:35.308753 16627 tablet_bootstrap.cc:492] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c: No bootstrap required, opened a new log
I20260809 18:46:35.308815 16627 ts_tablet_manager.cc:1397] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:35.308971 16627 raft_consensus.cc:348] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:35.309044 16627 raft_consensus.cc:374] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:35.309063 16627 raft_consensus.cc:729] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef44026ec6194fdbb019d29182ac646c, State: Initialized, Role: FOLLOWER
I20260809 18:46:35.309119 16627 consensus_queue.cc:260] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:35.309239 16627 ts_tablet_manager.cc:1428] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:35.309271 16638 tablet_replica.cc:439] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } }
I20260809 18:46:35.309414 16638 tablet_replica.cc:442] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:46:35.309602 16636 tablet_bootstrap.cc:492] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340: Bootstrap starting.
I20260809 18:46:35.310041 16636 tablet_bootstrap.cc:654] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:35.310407 16626 tablet_bootstrap.cc:492] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830: Bootstrap starting.
I20260809 18:46:35.310734 16636 tablet_bootstrap.cc:492] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340: No bootstrap required, opened a new log
I20260809 18:46:35.310779 16636 ts_tablet_manager.cc:1397] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:35.310946 16626 tablet_bootstrap.cc:654] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:35.310935 16636 raft_consensus.cc:348] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:35.310993 16636 raft_consensus.cc:374] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:35.311007 16636 raft_consensus.cc:729] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08101e55a83b4b83bfa6a419d44ad340, State: Initialized, Role: FOLLOWER
I20260809 18:46:35.311079 16636 consensus_queue.cc:260] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:35.311204 16636 ts_tablet_manager.cc:1428] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:35.311252 16640 tablet_replica.cc:439] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } }
I20260809 18:46:35.311314 16640 tablet_replica.cc:442] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:46:35.311841 16626 tablet_bootstrap.cc:492] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830: No bootstrap required, opened a new log
I20260809 18:46:35.311892 16626 ts_tablet_manager.cc:1397] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:35.312047 16626 raft_consensus.cc:348] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:35.312119 16626 raft_consensus.cc:374] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:35.312132 16626 raft_consensus.cc:729] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d6ceec6c2647b6a52af46655263830, State: Initialized, Role: FOLLOWER
I20260809 18:46:35.312199 16626 consensus_queue.cc:260] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:35.312289 16626 ts_tablet_manager.cc:1428] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:35.312376 16631 tablet_replica.cc:439] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } }
I20260809 18:46:35.312474 16631 tablet_replica.cc:442] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830: This TxnStatusTablet replica's current role is: FOLLOWER
W20260809 18:46:35.368017 16591 tablet.cc:2369] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:46:35.383523 16631 raft_consensus.cc:482] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:46:35.383628 16631 raft_consensus.cc:504] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:35.383965 16631 leader_election.cc:288] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef44026ec6194fdbb019d29182ac646c (127.12.202.193:45211), 08101e55a83b4b83bfa6a419d44ad340 (127.12.202.194:43371)
I20260809 18:46:35.386830 16429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.384151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:45211 (local address 127.12.202.195:45525)
0809 18:46:35.384199 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:35.384211 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:35.384256 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:35.384459 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:35.384460 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:35.384462 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:35.384527 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.384529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.385263 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.385264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.385982 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.385984 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.386552 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.386553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.386644 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.386647 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:46:35.386719 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 18:46:35.386758 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260809 18:46:35.386830 16620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.384241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:45525 (local address 127.12.202.193:45211)
0809 18:46:35.384317 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:35.384319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:35.384327 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:46:35.384354 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:35.384355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:35.384364 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:35.384421 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:35.384625 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.385161 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.386079 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.386455 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.386552 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.386561 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:35.386730 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 18:46:35.386765 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 18:46:35.386950 16662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.384150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:43371 (local address 127.12.202.195:47439)
0809 18:46:35.384442 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:35.384452 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:35.384525 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:35.384636 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:35.384636 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:35.384638 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:35.384727 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.384728 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.385410 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.385411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.386092 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.386094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.386672 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.386673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.386739 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.386742 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:46:35.386821 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 18:46:35.386861 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"mutex_wait_us":75,"thread_start_us":135,"threads_started":1}
I20260809 18:46:35.386937 16623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.384233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:47439 (local address 127.12.202.194:43371)
0809 18:46:35.384280 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:35.384282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:35.384522 (+ 240us) server_negotiation.cc:407] Connection header received
0809 18:46:35.384575 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:35.384576 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:35.384587 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:35.384636 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:35.384835 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.385322 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.386183 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.386570 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.386656 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.386665 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:35.386834 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 18:46:35.386874 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:46:35.387184 16091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49db0bfd9a224e2389f9f0edadf4417c" candidate_uuid: "07d6ceec6c2647b6a52af46655263830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef44026ec6194fdbb019d29182ac646c" is_pre_election: true
I20260809 18:46:35.387291 16091 raft_consensus.cc:2454] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d6ceec6c2647b6a52af46655263830 in term 0.
I20260809 18:46:35.387385 16302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49db0bfd9a224e2389f9f0edadf4417c" candidate_uuid: "07d6ceec6c2647b6a52af46655263830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08101e55a83b4b83bfa6a419d44ad340" is_pre_election: true
I20260809 18:46:35.387504 16420 leader_election.cc:302] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d6ceec6c2647b6a52af46655263830, ef44026ec6194fdbb019d29182ac646c; no voters:
I20260809 18:46:35.387530 16302 raft_consensus.cc:2454] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d6ceec6c2647b6a52af46655263830 in term 0.
I20260809 18:46:35.387638 16631 raft_consensus.cc:2781] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:46:35.387676 16631 raft_consensus.cc:482] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:46:35.387694 16631 raft_consensus.cc:3037] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:35.388423 16631 raft_consensus.cc:504] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:35.388578 16631 leader_election.cc:288] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [CANDIDATE]: Term 1 election: Requested vote from peers ef44026ec6194fdbb019d29182ac646c (127.12.202.193:45211), 08101e55a83b4b83bfa6a419d44ad340 (127.12.202.194:43371)
I20260809 18:46:35.388741 16091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49db0bfd9a224e2389f9f0edadf4417c" candidate_uuid: "07d6ceec6c2647b6a52af46655263830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef44026ec6194fdbb019d29182ac646c"
I20260809 18:46:35.388780 16302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49db0bfd9a224e2389f9f0edadf4417c" candidate_uuid: "07d6ceec6c2647b6a52af46655263830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08101e55a83b4b83bfa6a419d44ad340"
I20260809 18:46:35.388829 16091 raft_consensus.cc:3037] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:35.388872 16302 raft_consensus.cc:3037] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:35.389426 16091 raft_consensus.cc:2454] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d6ceec6c2647b6a52af46655263830 in term 1.
I20260809 18:46:35.389569 16302 raft_consensus.cc:2454] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d6ceec6c2647b6a52af46655263830 in term 1.
I20260809 18:46:35.389613 16420 leader_election.cc:302] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d6ceec6c2647b6a52af46655263830, ef44026ec6194fdbb019d29182ac646c; no voters:
I20260809 18:46:35.389691 16631 raft_consensus.cc:2781] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:35.389815 16631 raft_consensus.cc:686] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [term 1 LEADER]: Becoming Leader. State: Replica: 07d6ceec6c2647b6a52af46655263830, State: Running, Role: LEADER
I20260809 18:46:35.389931 16631 consensus_queue.cc:237] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:35.390385 16663 tablet_replica.cc:439] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830: TxnStatusTablet state changed. Reason: New leader 07d6ceec6c2647b6a52af46655263830. Latest consensus state: current_term: 1 leader_uuid: "07d6ceec6c2647b6a52af46655263830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } }
I20260809 18:46:35.390488 16663 tablet_replica.cc:442] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:46:35.390681 16665 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 18:46:35.390825 16665 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 18:46:35.390801 15849 catalog_manager.cc:5495] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d6ceec6c2647b6a52af46655263830 (127.12.202.195). New cstate: current_term: 1 leader_uuid: "07d6ceec6c2647b6a52af46655263830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } health_report { overall_health: HEALTHY } } }
I20260809 18:46:35.402603 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.400183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42024 (local address 127.12.202.195:35061)
0809 18:46:35.400221 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:35.400223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:35.400280 (+ 57us) server_negotiation.cc:407] Connection header received
0809 18:46:35.400401 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:35.400402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:35.400418 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:35.400497 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:46:35.400618 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.401101 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.401804 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.402004 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.402076 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.402264 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:46:35.402361 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:46:35.402445 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:35.402504 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 18:46:35.402524 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 18:46:35.402621 16655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.400097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:35061 (local address 127.0.0.1:42024)
0809 18:46:35.400240 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:35.400249 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:35.400326 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:35.400505 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:35.400506 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:35.400507 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:46:35.400567 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.400570 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.401181 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.401182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.401692 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.401694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.402077 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.402078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.402150 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.402163 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:46:35.402438 (+ 275us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:46:35.402448 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 18:46:35.402499 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 18:46:35.402546 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110}
I20260809 18:46:35.404186 16091 raft_consensus.cc:1261] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c [term 1 FOLLOWER]: Refusing update from remote peer 07d6ceec6c2647b6a52af46655263830: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:35.404186 16302 raft_consensus.cc:1261] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340 [term 1 FOLLOWER]: Refusing update from remote peer 07d6ceec6c2647b6a52af46655263830: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:35.404476 16631 consensus_queue.cc:1035] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:35.404568 16663 consensus_queue.cc:1035] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:35.405682 16640 tablet_replica.cc:439] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340: TxnStatusTablet state changed. Reason: New leader 07d6ceec6c2647b6a52af46655263830. Latest consensus state: current_term: 1 leader_uuid: "07d6ceec6c2647b6a52af46655263830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } }
I20260809 18:46:35.405768 16640 tablet_replica.cc:442] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:46:35.405781 16638 tablet_replica.cc:439] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c: TxnStatusTablet state changed. Reason: New leader 07d6ceec6c2647b6a52af46655263830. Latest consensus state: current_term: 1 leader_uuid: "07d6ceec6c2647b6a52af46655263830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } }
I20260809 18:46:35.405874 16638 tablet_replica.cc:442] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:46:35.406754 16672 mvcc.cc:205] Tried to move back new op lower bound from 7316689696373329920 to 7316689696317820928. Current Snapshot: MvccSnapshot[applied={T|T < 7316689696373329920}]
I20260809 18:46:35.406934 16663 tablet_replica.cc:439] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "07d6ceec6c2647b6a52af46655263830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } }
I20260809 18:46:35.407006 16663 tablet_replica.cc:442] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:46:35.407158 16638 tablet_replica.cc:439] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "07d6ceec6c2647b6a52af46655263830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } }
I20260809 18:46:35.407234 16638 tablet_replica.cc:442] T 49db0bfd9a224e2389f9f0edadf4417c P ef44026ec6194fdbb019d29182ac646c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:46:35.407248 16677 mvcc.cc:205] Tried to move back new op lower bound from 7316689696373329920 to 7316689696317820928. Current Snapshot: MvccSnapshot[applied={T|T < 7316689696373329920}]
I20260809 18:46:35.407333 16640 tablet_replica.cc:439] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "07d6ceec6c2647b6a52af46655263830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } }
I20260809 18:46:35.407397 16640 tablet_replica.cc:442] T 49db0bfd9a224e2389f9f0edadf4417c P 08101e55a83b4b83bfa6a419d44ad340: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:46:35.407979 16631 tablet_replica.cc:439] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "07d6ceec6c2647b6a52af46655263830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } } }
I20260809 18:46:35.408063 16631 tablet_replica.cc:442] T 49db0bfd9a224e2389f9f0edadf4417c P 07d6ceec6c2647b6a52af46655263830: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:46:35.408592 16675 mvcc.cc:205] Tried to move back new op lower bound from 7316689696373329920 to 7316689696317820928. Current Snapshot: MvccSnapshot[applied={T|T < 7316689696373329920}]
I20260809 18:46:35.411629 16623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.409345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42536 (local address 127.12.202.194:43371)
0809 18:46:35.409394 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:35.409396 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:35.409405 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:46:35.409457 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:35.409458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:35.409473 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:35.409526 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:46:35.409677 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.410147 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.410871 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.411067 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.411141 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.411312 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:46:35.411406 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:46:35.411484 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:35.411540 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 18:46:35.411561 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 18:46:35.416133 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.413987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:56685 (local address 127.12.202.195:35061)
0809 18:46:35.414043 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:35.414045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:35.414054 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:46:35.414097 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:35.414097 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:35.414106 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:35.414159 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:46:35.414291 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.414723 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.415450 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.415629 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.415704 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.415899 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:46:35.415933 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:46:35.415997 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:35.416055 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 18:46:35.416072 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 18:46:35.416152 16383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.413877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:35061 (local address 127.12.202.194:56685)
0809 18:46:35.413967 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:35.413978 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:35.414043 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:35.414163 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:35.414164 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:35.414164 (+ 0us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:46:35.414225 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.414226 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.414805 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.414806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.415347 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.415348 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.415709 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.415728 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.415795 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.415808 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:46:35.415998 (+ 190us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:46:35.416000 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:46:35.416051 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 18:46:35.416089 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 18:46:35.418433 16091 raft_consensus.cc:1261] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c [term 1 FOLLOWER]: Refusing update from remote peer 08101e55a83b4b83bfa6a419d44ad340: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:35.418534 16524 raft_consensus.cc:1261] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830 [term 1 FOLLOWER]: Refusing update from remote peer 08101e55a83b4b83bfa6a419d44ad340: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:35.418660 16642 consensus_queue.cc:1035] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:35.418761 16640 consensus_queue.cc:1035] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:35.428424 16623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.425832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:57517 (local address 127.12.202.194:43371)
0809 18:46:35.425889 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:35.425891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:35.425898 (+ 7us) server_negotiation.cc:407] Connection header received
0809 18:46:35.425915 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:35.425915 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:35.425923 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:35.425966 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:46:35.426113 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.426556 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.427669 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.427835 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.427886 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.428131 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:46:35.428157 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:46:35.428215 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:35.428339 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 18:46:35.428359 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 18:46:35.428442 16599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.425640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:43371 (local address 127.12.202.195:57517)
0809 18:46:35.425711 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:35.425722 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:35.425765 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:35.425990 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:35.425991 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:35.425992 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:46:35.426052 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.426053 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.426632 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.426633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.427591 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.427593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.427890 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.427891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.427973 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.428006 (+ 33us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:46:35.428240 (+ 234us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:46:35.428242 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:46:35.428329 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 18:46:35.428369 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 18:46:35.437958 15855 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:46:35.438067 15855 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:46:35.438834 15855 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6: Sending DeleteTablet for 3 replicas of tablet 6ae6bedc5a5e49979184aa3dd84cd70f
I20260809 18:46:35.439110 16489 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ae6bedc5a5e49979184aa3dd84cd70f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:35 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:42016
I20260809 18:46:35.439149 16062 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ae6bedc5a5e49979184aa3dd84cd70f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:35 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:41960
I20260809 18:46:35.439260 16273 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ae6bedc5a5e49979184aa3dd84cd70f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:35 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:42528
I20260809 18:46:35.439466 16704 tablet_replica.cc:330] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c: stopping tablet replica
I20260809 18:46:35.439615 16704 raft_consensus.cc:2229] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:46:35.439728 16704 raft_consensus.cc:2258] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:35.439708 15855 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51920:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:46:35.439857 15855 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:46:35.440225 16703 tablet_replica.cc:330] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830: stopping tablet replica
I20260809 18:46:35.440362 16703 raft_consensus.cc:2229] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:46:35.440425 16703 raft_consensus.cc:2258] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:35.441172 16703 ts_tablet_manager.cc:1905] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:35.441169 16062 tablet_service.cc:1467] Processing CreateTablet for tablet d009c4dcf3234b8eb95c6536b228b1bf (DEFAULT_TABLE table=test-table [id=79a2ec4796d14ebd8446f26db025f28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:35.441303 16062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d009c4dcf3234b8eb95c6536b228b1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:35.442698 16489 tablet_service.cc:1467] Processing CreateTablet for tablet d009c4dcf3234b8eb95c6536b228b1bf (DEFAULT_TABLE table=test-table [id=79a2ec4796d14ebd8446f26db025f28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:35.442796 16489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d009c4dcf3234b8eb95c6536b228b1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:35.443151 16703 ts_tablet_manager.cc:1918] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:46:35.443218 16703 log.cc:1196] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/6ae6bedc5a5e49979184aa3dd84cd70f
I20260809 18:46:35.443548 16703 ts_tablet_manager.cc:1939] T 6ae6bedc5a5e49979184aa3dd84cd70f P 07d6ceec6c2647b6a52af46655263830: Deleting consensus metadata
I20260809 18:46:35.443935 16627 tablet_bootstrap.cc:492] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c: Bootstrap starting.
I20260809 18:46:35.443981 15822 catalog_manager.cc:4841] TS 07d6ceec6c2647b6a52af46655263830 (127.12.202.195:35061): tablet 6ae6bedc5a5e49979184aa3dd84cd70f (table test-table [id=65deb53752b14b65aa3f45f5dff9cb3f]) successfully deleted
I20260809 18:46:35.444355 16627 tablet_bootstrap.cc:654] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:35.444712 16626 tablet_bootstrap.cc:492] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830: Bootstrap starting.
I20260809 18:46:35.445133 16626 tablet_bootstrap.cc:654] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:35.445901 16273 tablet_service.cc:1467] Processing CreateTablet for tablet d009c4dcf3234b8eb95c6536b228b1bf (DEFAULT_TABLE table=test-table [id=79a2ec4796d14ebd8446f26db025f28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:35.446017 16273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d009c4dcf3234b8eb95c6536b228b1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:35.446182 16626 tablet_bootstrap.cc:492] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830: No bootstrap required, opened a new log
I20260809 18:46:35.446221 16626 ts_tablet_manager.cc:1397] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 18:46:35.446382 16626 raft_consensus.cc:348] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:35.446441 16626 raft_consensus.cc:374] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:35.446461 16626 raft_consensus.cc:729] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d6ceec6c2647b6a52af46655263830, State: Initialized, Role: FOLLOWER
I20260809 18:46:35.446502 16626 consensus_queue.cc:260] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:35.446579 16626 ts_tablet_manager.cc:1428] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 18:46:35.447378 16636 tablet_bootstrap.cc:492] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340: Bootstrap starting.
I20260809 18:46:35.447423 16627 tablet_bootstrap.cc:492] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c: No bootstrap required, opened a new log
I20260809 18:46:35.447466 16627 ts_tablet_manager.cc:1397] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260809 18:46:35.447604 16627 raft_consensus.cc:348] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:35.447705 16627 raft_consensus.cc:374] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:35.447726 16627 raft_consensus.cc:729] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef44026ec6194fdbb019d29182ac646c, State: Initialized, Role: FOLLOWER
I20260809 18:46:35.447765 16636 tablet_bootstrap.cc:654] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:35.447767 16627 consensus_queue.cc:260] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:35.447845 16627 ts_tablet_manager.cc:1428] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:35.448653 16704 ts_tablet_manager.cc:1905] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:35.448988 16636 tablet_bootstrap.cc:492] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340: No bootstrap required, opened a new log
I20260809 18:46:35.449043 16636 ts_tablet_manager.cc:1397] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:46:35.449200 16636 raft_consensus.cc:348] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:35.449267 16636 raft_consensus.cc:374] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:35.449286 16636 raft_consensus.cc:729] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08101e55a83b4b83bfa6a419d44ad340, State: Initialized, Role: FOLLOWER
I20260809 18:46:35.449326 16636 consensus_queue.cc:260] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:35.449417 16636 ts_tablet_manager.cc:1428] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:35.451375 16705 tablet_replica.cc:330] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340: stopping tablet replica
I20260809 18:46:35.451367 16704 ts_tablet_manager.cc:1918] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:46:35.451445 16704 log.cc:1196] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/wal/wals/6ae6bedc5a5e49979184aa3dd84cd70f
I20260809 18:46:35.451480 16705 raft_consensus.cc:2229] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:46:35.451601 16705 raft_consensus.cc:2258] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:35.451747 16704 ts_tablet_manager.cc:1939] T 6ae6bedc5a5e49979184aa3dd84cd70f P ef44026ec6194fdbb019d29182ac646c: Deleting consensus metadata
I20260809 18:46:35.452049 16705 ts_tablet_manager.cc:1905] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:35.452139 15825 catalog_manager.cc:4841] TS ef44026ec6194fdbb019d29182ac646c (127.12.202.193:45211): tablet 6ae6bedc5a5e49979184aa3dd84cd70f (table test-table [id=65deb53752b14b65aa3f45f5dff9cb3f]) successfully deleted
I20260809 18:46:35.453406 16705 ts_tablet_manager.cc:1918] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:46:35.453537 16705 log.cc:1196] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/6ae6bedc5a5e49979184aa3dd84cd70f
I20260809 18:46:35.453861 16705 ts_tablet_manager.cc:1939] T 6ae6bedc5a5e49979184aa3dd84cd70f P 08101e55a83b4b83bfa6a419d44ad340: Deleting consensus metadata
I20260809 18:46:35.454257 15820 catalog_manager.cc:4841] TS 08101e55a83b4b83bfa6a419d44ad340 (127.12.202.194:43371): tablet 6ae6bedc5a5e49979184aa3dd84cd70f (table test-table [id=65deb53752b14b65aa3f45f5dff9cb3f]) successfully deleted
I20260809 18:46:35.612673 16631 raft_consensus.cc:482] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:46:35.612774 16631 raft_consensus.cc:504] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:35.612980 16631 leader_election.cc:288] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef44026ec6194fdbb019d29182ac646c (127.12.202.193:45211), 08101e55a83b4b83bfa6a419d44ad340 (127.12.202.194:43371)
I20260809 18:46:35.613256 16091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d009c4dcf3234b8eb95c6536b228b1bf" candidate_uuid: "07d6ceec6c2647b6a52af46655263830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef44026ec6194fdbb019d29182ac646c" is_pre_election: true
I20260809 18:46:35.613255 16302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d009c4dcf3234b8eb95c6536b228b1bf" candidate_uuid: "07d6ceec6c2647b6a52af46655263830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08101e55a83b4b83bfa6a419d44ad340" is_pre_election: true
I20260809 18:46:35.613371 16302 raft_consensus.cc:2454] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d6ceec6c2647b6a52af46655263830 in term 0.
I20260809 18:46:35.613372 16091 raft_consensus.cc:2454] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d6ceec6c2647b6a52af46655263830 in term 0.
I20260809 18:46:35.613552 16420 leader_election.cc:302] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d6ceec6c2647b6a52af46655263830, ef44026ec6194fdbb019d29182ac646c; no voters:
I20260809 18:46:35.613657 16631 raft_consensus.cc:2781] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:46:35.613706 16631 raft_consensus.cc:482] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:46:35.613739 16631 raft_consensus.cc:3037] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:35.614440 16631 raft_consensus.cc:504] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:35.614600 16631 leader_election.cc:288] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [CANDIDATE]: Term 1 election: Requested vote from peers ef44026ec6194fdbb019d29182ac646c (127.12.202.193:45211), 08101e55a83b4b83bfa6a419d44ad340 (127.12.202.194:43371)
I20260809 18:46:35.614768 16302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d009c4dcf3234b8eb95c6536b228b1bf" candidate_uuid: "07d6ceec6c2647b6a52af46655263830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08101e55a83b4b83bfa6a419d44ad340"
I20260809 18:46:35.614787 16091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d009c4dcf3234b8eb95c6536b228b1bf" candidate_uuid: "07d6ceec6c2647b6a52af46655263830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef44026ec6194fdbb019d29182ac646c"
I20260809 18:46:35.614863 16302 raft_consensus.cc:3037] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:35.614881 16091 raft_consensus.cc:3037] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:35.615583 16091 raft_consensus.cc:2454] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d6ceec6c2647b6a52af46655263830 in term 1.
I20260809 18:46:35.615665 16302 raft_consensus.cc:2454] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d6ceec6c2647b6a52af46655263830 in term 1.
I20260809 18:46:35.615785 16420 leader_election.cc:302] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d6ceec6c2647b6a52af46655263830, ef44026ec6194fdbb019d29182ac646c; no voters:
I20260809 18:46:35.616031 16631 raft_consensus.cc:2781] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:35.616115 16631 raft_consensus.cc:686] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [term 1 LEADER]: Becoming Leader. State: Replica: 07d6ceec6c2647b6a52af46655263830, State: Running, Role: LEADER
I20260809 18:46:35.616173 16631 consensus_queue.cc:237] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:35.616828 15855 catalog_manager.cc:5495] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d6ceec6c2647b6a52af46655263830 (127.12.202.195). New cstate: current_term: 1 leader_uuid: "07d6ceec6c2647b6a52af46655263830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } health_report { overall_health: HEALTHY } } }
I20260809 18:46:35.635073 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.633099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42040 (local address 127.12.202.195:35061)
0809 18:46:35.633150 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:35.633152 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:35.633158 (+ 6us) server_negotiation.cc:407] Connection header received
0809 18:46:35.633214 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:35.633215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:35.633223 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:35.633269 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:46:35.633353 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.633812 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.634457 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.634627 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.634675 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.634846 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:46:35.634869 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:46:35.634906 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:35.634962 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 18:46:35.634989 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:46:35.638762 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.636979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:34371 (local address 127.12.202.195:35061)
0809 18:46:35.637013 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:35.637015 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:35.637025 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:46:35.637088 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:35.637088 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:35.637096 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:35.637131 (+ 35us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:46:35.637199 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.637620 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.638279 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.638441 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.638487 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.638594 (+ 107us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:46:35.638614 (+ 20us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:46:35.638649 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:35.638678 (+ 29us) server_negotiation.cc:299] Negotiation successful
0809 18:46:35.638696 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":16}
I20260809 18:46:35.638828 16599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:35.636937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:35061 (local address 127.12.202.195:34371)
0809 18:46:35.636990 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:35.636998 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:35.637033 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:35.637133 (+ 100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:35.637133 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:35.637134 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:46:35.637166 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.637167 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.637675 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.637676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.638211 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:35.638212 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:35.638501 (+ 289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:35.638501 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:35.638536 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:35.638540 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:46:35.638648 (+ 108us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:46:35.638649 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 18:46:35.638677 (+ 28us) client_negotiation.cc:240] Negotiation successful
0809 18:46:35.638710 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":2}
I20260809 18:46:35.640654 16302 raft_consensus.cc:1261] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340 [term 1 FOLLOWER]: Refusing update from remote peer 07d6ceec6c2647b6a52af46655263830: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:35.640730 16091 raft_consensus.cc:1261] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c [term 1 FOLLOWER]: Refusing update from remote peer 07d6ceec6c2647b6a52af46655263830: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:35.640889 16631 consensus_queue.cc:1035] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:35.640978 16663 consensus_queue.cc:1035] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 18:46:35.645649 16672 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 18:46:37.164247 15849 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:46:37.164372 15849 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:46:37.165215 15849 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6: Sending DeleteTablet for 3 replicas of tablet d009c4dcf3234b8eb95c6536b228b1bf
I20260809 18:46:37.165494 16062 tablet_service.cc:1514] Processing DeleteTablet for tablet d009c4dcf3234b8eb95c6536b228b1bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:37 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:41960
I20260809 18:46:37.165493 16489 tablet_service.cc:1514] Processing DeleteTablet for tablet d009c4dcf3234b8eb95c6536b228b1bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:37 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:42016
I20260809 18:46:37.165542 16273 tablet_service.cc:1514] Processing DeleteTablet for tablet d009c4dcf3234b8eb95c6536b228b1bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:37 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:42528
I20260809 18:46:37.165729 16751 tablet_replica.cc:330] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340: stopping tablet replica
I20260809 18:46:37.165729 16750 tablet_replica.cc:330] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c: stopping tablet replica
I20260809 18:46:37.165794 16750 raft_consensus.cc:2229] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:46:37.165805 16749 tablet_replica.cc:330] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830: stopping tablet replica
I20260809 18:46:37.165825 16751 raft_consensus.cc:2229] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:46:37.165855 16750 raft_consensus.cc:2258] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:37.165874 16751 raft_consensus.cc:2258] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:37.165894 16749 raft_consensus.cc:2229] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:46:37.166115 16749 raft_consensus.cc:2258] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:37.166131 16750 ts_tablet_manager.cc:1905] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:37.166131 16751 ts_tablet_manager.cc:1905] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:37.166407 16749 ts_tablet_manager.cc:1905] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:37.167927 16751 ts_tablet_manager.cc:1918] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 18:46:37.167922 16750 ts_tablet_manager.cc:1918] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 18:46:37.167989 16750 log.cc:1196] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/wal/wals/d009c4dcf3234b8eb95c6536b228b1bf
I20260809 18:46:37.168015 16751 log.cc:1196] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/d009c4dcf3234b8eb95c6536b228b1bf
I20260809 18:46:37.168273 16750 ts_tablet_manager.cc:1939] T d009c4dcf3234b8eb95c6536b228b1bf P ef44026ec6194fdbb019d29182ac646c: Deleting consensus metadata
I20260809 18:46:37.168287 16751 ts_tablet_manager.cc:1939] T d009c4dcf3234b8eb95c6536b228b1bf P 08101e55a83b4b83bfa6a419d44ad340: Deleting consensus metadata
I20260809 18:46:37.168401 16749 ts_tablet_manager.cc:1918] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 18:46:37.168495 16749 log.cc:1196] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/d009c4dcf3234b8eb95c6536b228b1bf
I20260809 18:46:37.168659 15820 catalog_manager.cc:4841] TS 08101e55a83b4b83bfa6a419d44ad340 (127.12.202.194:43371): tablet d009c4dcf3234b8eb95c6536b228b1bf (table test-table [id=79a2ec4796d14ebd8446f26db025f28b]) successfully deleted
I20260809 18:46:37.168709 15825 catalog_manager.cc:4841] TS ef44026ec6194fdbb019d29182ac646c (127.12.202.193:45211): tablet d009c4dcf3234b8eb95c6536b228b1bf (table test-table [id=79a2ec4796d14ebd8446f26db025f28b]) successfully deleted
I20260809 18:46:37.168753 16749 ts_tablet_manager.cc:1939] T d009c4dcf3234b8eb95c6536b228b1bf P 07d6ceec6c2647b6a52af46655263830: Deleting consensus metadata
I20260809 18:46:37.169092 15822 catalog_manager.cc:4841] TS 07d6ceec6c2647b6a52af46655263830 (127.12.202.195:35061): tablet d009c4dcf3234b8eb95c6536b228b1bf (table test-table [id=79a2ec4796d14ebd8446f26db025f28b]) successfully deleted
Aug 09 18:46:37 dist-test-slave-45dx krb5kdc[15774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301197, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 18:46:37 dist-test-slave-45dx krb5kdc[15774](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301197, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:37.195616 16770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:37.184824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51936 (local address 127.12.202.254:36853)
0809 18:46:37.184990 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:37.184992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:37.185000 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:46:37.185024 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:37.185025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:37.185036 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:37.185098 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:37.185666 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.186171 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.186877 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.187073 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.187128 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:37.192930 (+ 5802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:37.192931 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:37.192931 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:37.192938 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:37.194518 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:37.194837 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:37.194838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:37.194838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:37.194903 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:37.195081 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:37.195082 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:37.195082 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:37.195195 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:37.195283 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:37.195468 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 18:46:37.195543 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":108,"threads_started":1}
I20260809 18:46:37.197252 15849 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51936:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:46:37.197492 15849 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:46:37.198925 16062 tablet_service.cc:1467] Processing CreateTablet for tablet da582244067148d5ac881120f91d23ba (DEFAULT_TABLE table=test-table [id=3ded9f2c64404ed0b1cf7f4a77720bbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:37.199051 16489 tablet_service.cc:1467] Processing CreateTablet for tablet da582244067148d5ac881120f91d23ba (DEFAULT_TABLE table=test-table [id=3ded9f2c64404ed0b1cf7f4a77720bbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:37.199055 16273 tablet_service.cc:1467] Processing CreateTablet for tablet da582244067148d5ac881120f91d23ba (DEFAULT_TABLE table=test-table [id=3ded9f2c64404ed0b1cf7f4a77720bbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:37.199105 16062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da582244067148d5ac881120f91d23ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:37.199188 16489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da582244067148d5ac881120f91d23ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:37.199199 16273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da582244067148d5ac881120f91d23ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:37.200645 16771 tablet_bootstrap.cc:492] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340: Bootstrap starting.
I20260809 18:46:37.200903 16774 tablet_bootstrap.cc:492] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830: Bootstrap starting.
I20260809 18:46:37.200999 16772 tablet_bootstrap.cc:492] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c: Bootstrap starting.
I20260809 18:46:37.201081 16771 tablet_bootstrap.cc:654] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:37.201293 16774 tablet_bootstrap.cc:654] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:37.201454 16772 tablet_bootstrap.cc:654] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:37.201730 16771 tablet_bootstrap.cc:492] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340: No bootstrap required, opened a new log
I20260809 18:46:37.201866 16771 ts_tablet_manager.cc:1397] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:37.201989 16774 tablet_bootstrap.cc:492] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830: No bootstrap required, opened a new log
I20260809 18:46:37.202054 16774 ts_tablet_manager.cc:1397] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:37.202083 16772 tablet_bootstrap.cc:492] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c: No bootstrap required, opened a new log
I20260809 18:46:37.202037 16771 raft_consensus.cc:348] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:37.202121 16771 raft_consensus.cc:374] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:37.202126 16772 ts_tablet_manager.cc:1397] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:37.202142 16771 raft_consensus.cc:729] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08101e55a83b4b83bfa6a419d44ad340, State: Initialized, Role: FOLLOWER
I20260809 18:46:37.202211 16771 consensus_queue.cc:260] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:37.202186 16774 raft_consensus.cc:348] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:37.202275 16774 raft_consensus.cc:374] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:37.202297 16774 raft_consensus.cc:729] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d6ceec6c2647b6a52af46655263830, State: Initialized, Role: FOLLOWER
I20260809 18:46:37.202318 16772 raft_consensus.cc:348] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:37.202355 16774 consensus_queue.cc:260] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:37.202389 16772 raft_consensus.cc:374] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:37.202415 16771 ts_tablet_manager.cc:1428] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:37.202412 16772 raft_consensus.cc:729] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef44026ec6194fdbb019d29182ac646c, State: Initialized, Role: FOLLOWER
I20260809 18:46:37.202463 16774 ts_tablet_manager.cc:1428] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:37.202538 16772 consensus_queue.cc:260] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:37.202787 16772 ts_tablet_manager.cc:1428] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:37.327968 16663 raft_consensus.cc:482] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:46:37.328097 16663 raft_consensus.cc:504] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:37.328368 16663 leader_election.cc:288] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef44026ec6194fdbb019d29182ac646c (127.12.202.193:45211), 08101e55a83b4b83bfa6a419d44ad340 (127.12.202.194:43371)
I20260809 18:46:37.328598 16293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da582244067148d5ac881120f91d23ba" candidate_uuid: "07d6ceec6c2647b6a52af46655263830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08101e55a83b4b83bfa6a419d44ad340" is_pre_election: true
I20260809 18:46:37.328609 16091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da582244067148d5ac881120f91d23ba" candidate_uuid: "07d6ceec6c2647b6a52af46655263830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef44026ec6194fdbb019d29182ac646c" is_pre_election: true
I20260809 18:46:37.328694 16293 raft_consensus.cc:2454] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d6ceec6c2647b6a52af46655263830 in term 0.
I20260809 18:46:37.328715 16091 raft_consensus.cc:2454] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07d6ceec6c2647b6a52af46655263830 in term 0.
I20260809 18:46:37.328922 16416 leader_election.cc:302] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d6ceec6c2647b6a52af46655263830, 08101e55a83b4b83bfa6a419d44ad340; no voters:
I20260809 18:46:37.329036 16663 raft_consensus.cc:2781] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:46:37.329080 16663 raft_consensus.cc:482] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:46:37.329109 16663 raft_consensus.cc:3037] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:37.329910 16663 raft_consensus.cc:504] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:37.330054 16663 leader_election.cc:288] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [CANDIDATE]: Term 1 election: Requested vote from peers ef44026ec6194fdbb019d29182ac646c (127.12.202.193:45211), 08101e55a83b4b83bfa6a419d44ad340 (127.12.202.194:43371)
I20260809 18:46:37.330189 16293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da582244067148d5ac881120f91d23ba" candidate_uuid: "07d6ceec6c2647b6a52af46655263830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08101e55a83b4b83bfa6a419d44ad340"
I20260809 18:46:37.330209 16091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da582244067148d5ac881120f91d23ba" candidate_uuid: "07d6ceec6c2647b6a52af46655263830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef44026ec6194fdbb019d29182ac646c"
I20260809 18:46:37.330271 16293 raft_consensus.cc:3037] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:37.330292 16091 raft_consensus.cc:3037] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:37.330940 16293 raft_consensus.cc:2454] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d6ceec6c2647b6a52af46655263830 in term 1.
I20260809 18:46:37.331058 16091 raft_consensus.cc:2454] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07d6ceec6c2647b6a52af46655263830 in term 1.
I20260809 18:46:37.331125 16416 leader_election.cc:302] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d6ceec6c2647b6a52af46655263830, 08101e55a83b4b83bfa6a419d44ad340; no voters:
I20260809 18:46:37.331236 16663 raft_consensus.cc:2781] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:37.331293 16663 raft_consensus.cc:686] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [term 1 LEADER]: Becoming Leader. State: Replica: 07d6ceec6c2647b6a52af46655263830, State: Running, Role: LEADER
I20260809 18:46:37.331341 16663 consensus_queue.cc:237] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:37.332012 15849 catalog_manager.cc:5495] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07d6ceec6c2647b6a52af46655263830 (127.12.202.195). New cstate: current_term: 1 leader_uuid: "07d6ceec6c2647b6a52af46655263830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } health_report { overall_health: HEALTHY } } }
I20260809 18:46:37.350812 16790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:37.348364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42052 (local address 127.12.202.195:35061)
0809 18:46:37.348547 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:37.348549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:37.348559 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:46:37.348591 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:37.348591 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:37.348601 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:37.348674 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:46:37.348825 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.349313 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.350074 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.350291 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.350366 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:37.350525 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:46:37.350579 (+ 54us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:46:37.350625 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:37.350684 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 18:46:37.350706 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":99,"threads_started":1}
I20260809 18:46:37.353214 16091 raft_consensus.cc:1261] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c [term 1 FOLLOWER]: Refusing update from remote peer 07d6ceec6c2647b6a52af46655263830: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:37.353240 16293 raft_consensus.cc:1261] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340 [term 1 FOLLOWER]: Refusing update from remote peer 07d6ceec6c2647b6a52af46655263830: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:37.353432 16663 consensus_queue.cc:1035] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:37.353557 16733 consensus_queue.cc:1035] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:37.363168 15855 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:46:37.363282 15855 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:46:37.363968 15855 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6: Sending DeleteTablet for 3 replicas of tablet da582244067148d5ac881120f91d23ba
I20260809 18:46:37.364233 16273 tablet_service.cc:1514] Processing DeleteTablet for tablet da582244067148d5ac881120f91d23ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:37 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:42528
I20260809 18:46:37.364269 16062 tablet_service.cc:1514] Processing DeleteTablet for tablet da582244067148d5ac881120f91d23ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:37 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:41960
I20260809 18:46:37.364447 16751 tablet_replica.cc:330] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340: stopping tablet replica
I20260809 18:46:37.364521 16751 raft_consensus.cc:2229] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:46:37.364571 16751 raft_consensus.cc:2258] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:37.364650 16750 tablet_replica.cc:330] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c: stopping tablet replica
I20260809 18:46:37.364706 16750 raft_consensus.cc:2229] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:46:37.364756 16750 raft_consensus.cc:2258] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:37.364686 15855 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51936:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:46:37.364854 15855 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:46:37.365025 16489 tablet_service.cc:1514] Processing DeleteTablet for tablet da582244067148d5ac881120f91d23ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:37 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:42016
I20260809 18:46:37.365118 16749 tablet_replica.cc:330] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830: stopping tablet replica
I20260809 18:46:37.365177 16749 raft_consensus.cc:2229] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:46:37.365242 16749 raft_consensus.cc:2258] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:37.365460 16750 ts_tablet_manager.cc:1905] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:37.365495 16749 ts_tablet_manager.cc:1905] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:37.367167 16749 ts_tablet_manager.cc:1918] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:46:37.367237 16749 log.cc:1196] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/da582244067148d5ac881120f91d23ba
I20260809 18:46:37.367254 16750 ts_tablet_manager.cc:1918] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:46:37.367318 16750 log.cc:1196] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-0/wal/wals/da582244067148d5ac881120f91d23ba
I20260809 18:46:37.367365 16751 ts_tablet_manager.cc:1905] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:37.367477 16749 ts_tablet_manager.cc:1939] T da582244067148d5ac881120f91d23ba P 07d6ceec6c2647b6a52af46655263830: Deleting consensus metadata
I20260809 18:46:37.367575 16750 ts_tablet_manager.cc:1939] T da582244067148d5ac881120f91d23ba P ef44026ec6194fdbb019d29182ac646c: Deleting consensus metadata
I20260809 18:46:37.367925 15825 catalog_manager.cc:4841] TS ef44026ec6194fdbb019d29182ac646c (127.12.202.193:45211): tablet da582244067148d5ac881120f91d23ba (table test-table [id=3ded9f2c64404ed0b1cf7f4a77720bbc]) successfully deleted
I20260809 18:46:37.368737 16273 tablet_service.cc:1467] Processing CreateTablet for tablet f80c8d9001ed4e0eacdfb3913c1feb5f (DEFAULT_TABLE table=test-table [id=643f3a2b8cb24b1baa3cfacb1631b0a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:37.368889 16273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f80c8d9001ed4e0eacdfb3913c1feb5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:37.369122 16751 ts_tablet_manager.cc:1918] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:46:37.369175 16751 log.cc:1196] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/da582244067148d5ac881120f91d23ba
I20260809 18:46:37.369402 16751 ts_tablet_manager.cc:1939] T da582244067148d5ac881120f91d23ba P 08101e55a83b4b83bfa6a419d44ad340: Deleting consensus metadata
I20260809 18:46:37.369596 15822 catalog_manager.cc:4841] TS 07d6ceec6c2647b6a52af46655263830 (127.12.202.195:35061): tablet da582244067148d5ac881120f91d23ba (table test-table [id=3ded9f2c64404ed0b1cf7f4a77720bbc]) successfully deleted
I20260809 18:46:37.369702 16062 tablet_service.cc:1467] Processing CreateTablet for tablet f80c8d9001ed4e0eacdfb3913c1feb5f (DEFAULT_TABLE table=test-table [id=643f3a2b8cb24b1baa3cfacb1631b0a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:37.369827 16062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f80c8d9001ed4e0eacdfb3913c1feb5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:37.369897 15820 catalog_manager.cc:4841] TS 08101e55a83b4b83bfa6a419d44ad340 (127.12.202.194:43371): tablet da582244067148d5ac881120f91d23ba (table test-table [id=3ded9f2c64404ed0b1cf7f4a77720bbc]) successfully deleted
I20260809 18:46:37.370093 16771 tablet_bootstrap.cc:492] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340: Bootstrap starting.
I20260809 18:46:37.370373 16771 tablet_bootstrap.cc:654] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:37.370903 16771 tablet_bootstrap.cc:492] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340: No bootstrap required, opened a new log
I20260809 18:46:37.370970 16771 ts_tablet_manager.cc:1397] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260809 18:46:37.371026 16772 tablet_bootstrap.cc:492] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c: Bootstrap starting.
I20260809 18:46:37.371107 16771 raft_consensus.cc:348] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:37.371145 16489 tablet_service.cc:1467] Processing CreateTablet for tablet f80c8d9001ed4e0eacdfb3913c1feb5f (DEFAULT_TABLE table=test-table [id=643f3a2b8cb24b1baa3cfacb1631b0a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:37.371187 16771 raft_consensus.cc:374] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:37.371217 16771 raft_consensus.cc:729] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08101e55a83b4b83bfa6a419d44ad340, State: Initialized, Role: FOLLOWER
I20260809 18:46:37.371268 16489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f80c8d9001ed4e0eacdfb3913c1feb5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:37.371258 16771 consensus_queue.cc:260] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:37.371371 16771 ts_tablet_manager.cc:1428] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:37.371798 16772 tablet_bootstrap.cc:654] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:37.372560 16772 tablet_bootstrap.cc:492] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c: No bootstrap required, opened a new log
I20260809 18:46:37.372632 16772 ts_tablet_manager.cc:1397] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:46:37.372794 16772 raft_consensus.cc:348] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:37.372828 16774 tablet_bootstrap.cc:492] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830: Bootstrap starting.
I20260809 18:46:37.372879 16772 raft_consensus.cc:374] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:37.372901 16772 raft_consensus.cc:729] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef44026ec6194fdbb019d29182ac646c, State: Initialized, Role: FOLLOWER
I20260809 18:46:37.372946 16772 consensus_queue.cc:260] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:37.373046 16772 ts_tablet_manager.cc:1428] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:37.373183 16774 tablet_bootstrap.cc:654] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:37.373898 16774 tablet_bootstrap.cc:492] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830: No bootstrap required, opened a new log
I20260809 18:46:37.373968 16774 ts_tablet_manager.cc:1397] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:37.374130 16774 raft_consensus.cc:348] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:37.374218 16774 raft_consensus.cc:374] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:37.374250 16774 raft_consensus.cc:729] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07d6ceec6c2647b6a52af46655263830, State: Initialized, Role: FOLLOWER
I20260809 18:46:37.374305 16774 consensus_queue.cc:260] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:37.374406 16774 ts_tablet_manager.cc:1428] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:37.460408 16779 raft_consensus.cc:482] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:46:37.460568 16779 raft_consensus.cc:504] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:37.460963 16779 leader_election.cc:288] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08101e55a83b4b83bfa6a419d44ad340 (127.12.202.194:43371), 07d6ceec6c2647b6a52af46655263830 (127.12.202.195:35061)
I20260809 18:46:37.464392 16790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:37.461387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:52973 (local address 127.12.202.195:35061)
0809 18:46:37.461439 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:37.461441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:37.461565 (+ 124us) server_negotiation.cc:407] Connection header received
0809 18:46:37.461677 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:37.461678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:37.461690 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:37.461721 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:37.462062 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.462566 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.463629 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.463994 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.464084 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:37.464094 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:37.464238 (+ 144us) server_negotiation.cc:299] Negotiation successful
0809 18:46:37.464282 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 18:46:37.464432 16799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:37.461170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:43371 (local address 127.12.202.193:59463)
0809 18:46:37.461424 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:37.461438 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:37.461500 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:37.461815 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:37.461816 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:37.461819 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:37.461965 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:37.461969 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.462686 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.462687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:37.463511 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:37.463513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.464099 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.464100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:37.464173 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:37.464176 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:46:37.464244 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 18:46:37.464286 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"mutex_wait_us":2,"thread_start_us":158,"threads_started":1}
I20260809 18:46:37.464421 16801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:37.461310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:59463 (local address 127.12.202.194:43371)
0809 18:46:37.461508 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:37.461511 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:37.461525 (+ 14us) server_negotiation.cc:407] Connection header received
0809 18:46:37.461561 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:37.461562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:37.461575 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:37.461654 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:37.462079 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.462566 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.463626 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.463994 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.464081 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:37.464090 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:37.464264 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 18:46:37.464340 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":81,"threads_started":1}
I20260809 18:46:37.464435 16800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:37.461170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:35061 (local address 127.12.202.193:52973)
0809 18:46:37.461482 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:37.461494 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:37.461593 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:37.461817 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:37.461818 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:37.461820 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:37.461975 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:37.461977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.462667 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.462668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:37.463510 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:37.463513 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.464083 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.464084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:37.464162 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:37.464165 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:46:37.464209 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 18:46:37.464280 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"mutex_wait_us":78,"thread_start_us":228,"threads_started":1}
I20260809 18:46:37.464810 16302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f80c8d9001ed4e0eacdfb3913c1feb5f" candidate_uuid: "ef44026ec6194fdbb019d29182ac646c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08101e55a83b4b83bfa6a419d44ad340" is_pre_election: true
I20260809 18:46:37.464948 16302 raft_consensus.cc:2454] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef44026ec6194fdbb019d29182ac646c in term 0.
I20260809 18:46:37.464926 16524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f80c8d9001ed4e0eacdfb3913c1feb5f" candidate_uuid: "ef44026ec6194fdbb019d29182ac646c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d6ceec6c2647b6a52af46655263830" is_pre_election: true
I20260809 18:46:37.465003 16524 raft_consensus.cc:2454] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef44026ec6194fdbb019d29182ac646c in term 0.
I20260809 18:46:37.465142 15982 leader_election.cc:302] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08101e55a83b4b83bfa6a419d44ad340, ef44026ec6194fdbb019d29182ac646c; no voters:
I20260809 18:46:37.465284 16779 raft_consensus.cc:2781] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:46:37.465323 16779 raft_consensus.cc:482] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:46:37.465346 16779 raft_consensus.cc:3037] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:37.466276 16779 raft_consensus.cc:504] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:37.466456 16779 leader_election.cc:288] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [CANDIDATE]: Term 1 election: Requested vote from peers 08101e55a83b4b83bfa6a419d44ad340 (127.12.202.194:43371), 07d6ceec6c2647b6a52af46655263830 (127.12.202.195:35061)
I20260809 18:46:37.466591 16302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f80c8d9001ed4e0eacdfb3913c1feb5f" candidate_uuid: "ef44026ec6194fdbb019d29182ac646c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08101e55a83b4b83bfa6a419d44ad340"
I20260809 18:46:37.466703 16302 raft_consensus.cc:3037] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:37.466660 16524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f80c8d9001ed4e0eacdfb3913c1feb5f" candidate_uuid: "ef44026ec6194fdbb019d29182ac646c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07d6ceec6c2647b6a52af46655263830"
I20260809 18:46:37.466738 16524 raft_consensus.cc:3037] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:37.467546 16524 raft_consensus.cc:2454] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef44026ec6194fdbb019d29182ac646c in term 1.
I20260809 18:46:37.467546 16302 raft_consensus.cc:2454] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef44026ec6194fdbb019d29182ac646c in term 1.
I20260809 18:46:37.467799 15984 leader_election.cc:302] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07d6ceec6c2647b6a52af46655263830, ef44026ec6194fdbb019d29182ac646c; no voters:
I20260809 18:46:37.467947 16779 raft_consensus.cc:2781] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:37.468144 16779 raft_consensus.cc:686] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [term 1 LEADER]: Becoming Leader. State: Replica: ef44026ec6194fdbb019d29182ac646c, State: Running, Role: LEADER
I20260809 18:46:37.468232 16779 consensus_queue.cc:237] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } }
I20260809 18:46:37.469056 15855 catalog_manager.cc:5495] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c reported cstate change: term changed from 0 to 1, leader changed from <none> to ef44026ec6194fdbb019d29182ac646c (127.12.202.193). New cstate: current_term: 1 leader_uuid: "ef44026ec6194fdbb019d29182ac646c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef44026ec6194fdbb019d29182ac646c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 } health_report { overall_health: UNKNOWN } } }
I20260809 18:46:37.490993 16807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:37.488594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41962 (local address 127.12.202.193:45211)
0809 18:46:37.488788 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:37.488789 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:37.488796 (+ 7us) server_negotiation.cc:407] Connection header received
0809 18:46:37.488830 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:37.488831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:37.488849 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:37.488953 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:46:37.489075 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.489566 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.490263 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.490464 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.490515 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:37.490642 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:46:37.490742 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:46:37.490795 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:37.490839 (+ 44us) server_negotiation.cc:299] Negotiation successful
0809 18:46:37.490857 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":120,"threads_started":1}
I20260809 18:46:37.495532 16790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:37.493560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:38399 (local address 127.12.202.195:35061)
0809 18:46:37.493620 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:37.493622 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:37.493726 (+ 104us) server_negotiation.cc:407] Connection header received
0809 18:46:37.493761 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:37.493762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:37.493774 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:37.493824 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:46:37.493914 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.494338 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.495003 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.495168 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.495215 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:37.495362 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:46:37.495383 (+ 21us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:46:37.495420 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:37.495464 (+ 44us) server_negotiation.cc:299] Negotiation successful
0809 18:46:37.495482 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 18:46:37.495553 16812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:37.493509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:35061 (local address 127.12.202.193:38399)
0809 18:46:37.493664 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:37.493674 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:37.493723 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:37.493828 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:37.493828 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:37.493830 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:46:37.493878 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:37.493879 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.494396 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.494397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:37.494935 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:37.494937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.495241 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.495241 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:37.495283 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:37.495297 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:46:37.495432 (+ 135us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:46:37.495433 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 18:46:37.495463 (+ 30us) client_negotiation.cc:240] Negotiation successful
0809 18:46:37.495492 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":101,"threads_started":1}
I20260809 18:46:37.497718 16302 raft_consensus.cc:1261] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340 [term 1 FOLLOWER]: Refusing update from remote peer ef44026ec6194fdbb019d29182ac646c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:37.497766 16524 raft_consensus.cc:1261] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830 [term 1 FOLLOWER]: Refusing update from remote peer ef44026ec6194fdbb019d29182ac646c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:37.498041 16779 consensus_queue.cc:1035] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [LEADER]: Connected to new peer: Peer: permanent_uuid: "08101e55a83b4b83bfa6a419d44ad340" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:37.498152 16802 consensus_queue.cc:1035] T f80c8d9001ed4e0eacdfb3913c1feb5f P ef44026ec6194fdbb019d29182ac646c [LEADER]: Connected to new peer: Peer: permanent_uuid: "07d6ceec6c2647b6a52af46655263830" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 35061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:37.505373 16807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:37.502915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:46471 (local address 127.12.202.193:45211)
0809 18:46:37.502966 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:37.502968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:37.503081 (+ 113us) server_negotiation.cc:407] Connection header received
0809 18:46:37.503127 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:37.503128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:37.503138 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:37.503193 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:46:37.503387 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.503853 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.504622 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.504887 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.504956 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:37.505122 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:46:37.505175 (+ 53us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:46:37.505223 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:37.505285 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 18:46:37.505305 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 18:46:37.505409 16819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:37.502858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:45211 (local address 127.12.202.195:46471)
0809 18:46:37.503006 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:37.503017 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:37.503078 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:37.503227 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:37.503228 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:37.503229 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:46:37.503263 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:37.503264 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.503919 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.503920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:37.504500 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:37.504502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:37.504976 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:37.504977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:37.505042 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:37.505046 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:46:37.505238 (+ 192us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:46:37.505240 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:46:37.505283 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 18:46:37.505330 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":86,"threads_started":1}
W20260809 18:46:37.505756 16726 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 18:46:39.024046 15852 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:46:39.024165 15852 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:46:39.024981 15852 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b85b45d51c9340728d3255b7a239c2d6: Sending DeleteTablet for 3 replicas of tablet f80c8d9001ed4e0eacdfb3913c1feb5f
I20260809 18:46:39.025221 16062 tablet_service.cc:1514] Processing DeleteTablet for tablet f80c8d9001ed4e0eacdfb3913c1feb5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:39 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:41960
I20260809 18:46:39.025275 16273 tablet_service.cc:1514] Processing DeleteTablet for tablet f80c8d9001ed4e0eacdfb3913c1feb5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:39 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:42528
I20260809 18:46:39.025269 16489 tablet_service.cc:1514] Processing DeleteTablet for tablet f80c8d9001ed4e0eacdfb3913c1feb5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:39 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:42016
I20260809 18:46:39.025470 16858 tablet_replica.cc:330] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340: stopping tablet replica
I20260809 18:46:39.025506 16863 tablet_replica.cc:330] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830: stopping tablet replica
I20260809 18:46:39.025535 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 15958
I20260809 18:46:39.025575 16863 raft_consensus.cc:2229] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:46:39.025564 16858 raft_consensus.cc:2229] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:46:39.030514 16858 raft_consensus.cc:2258] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:39.032171 16858 ts_tablet_manager.cc:1905] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:39.033269 16863 raft_consensus.cc:2258] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:39.034593 16858 ts_tablet_manager.cc:1918] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 18:46:39.034754 16858 log.cc:1196] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/f80c8d9001ed4e0eacdfb3913c1feb5f
I20260809 18:46:39.034739 16863 ts_tablet_manager.cc:1905] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:39.035053 16858 ts_tablet_manager.cc:1939] T f80c8d9001ed4e0eacdfb3913c1feb5f P 08101e55a83b4b83bfa6a419d44ad340: Deleting consensus metadata
I20260809 18:46:39.035878 15820 catalog_manager.cc:4841] TS 08101e55a83b4b83bfa6a419d44ad340 (127.12.202.194:43371): tablet f80c8d9001ed4e0eacdfb3913c1feb5f (table test-table [id=643f3a2b8cb24b1baa3cfacb1631b0a6]) successfully deleted
I20260809 18:46:39.037055 16863 ts_tablet_manager.cc:1918] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 18:46:39.037180 16863 log.cc:1196] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/f80c8d9001ed4e0eacdfb3913c1feb5f
I20260809 18:46:39.037520 16863 ts_tablet_manager.cc:1939] T f80c8d9001ed4e0eacdfb3913c1feb5f P 07d6ceec6c2647b6a52af46655263830: Deleting consensus metadata
I20260809 18:46:39.038900 15822 catalog_manager.cc:4841] TS 07d6ceec6c2647b6a52af46655263830 (127.12.202.195:35061): tablet f80c8d9001ed4e0eacdfb3913c1feb5f (table test-table [id=643f3a2b8cb24b1baa3cfacb1631b0a6]) successfully deleted
W20260809 18:46:39.047778 15825 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.202.193:45211 (error 108)
I20260809 18:46:39.048051 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 16172
I20260809 18:46:39.052357 16866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:39.050027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:45211 (local address 127.0.0.1:41974)
0809 18:46:39.052214 (+ 2187us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:39.052281 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:45211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2154,"thread_start_us":76,"threads_started":1}
W20260809 18:46:39.052520 15825 catalog_manager.cc:4584] TS ef44026ec6194fdbb019d29182ac646c (127.12.202.193:45211): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f80c8d9001ed4e0eacdfb3913c1feb5f: Network error: Client connection negotiation failed: client connection to 127.12.202.193:45211: connect: Connection refused (error 111)
I20260809 18:46:39.057672 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 16386
I20260809 18:46:39.069705 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 15791
2026-08-09T18:46:39Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5948 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:46:39 dist-test-slave-45dx krb5kdc[16869](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:46:39 dist-test-slave-45dx krb5kdc[16869](info): set up 2 sockets
Aug 09 18:46:39 dist-test-slave-45dx krb5kdc[16869](info): commencing operation
krb5kdc: starting...
W20260809 18:46:40.359714 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.261s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:46:40 dist-test-slave-45dx krb5kdc[16869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301200, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:46:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:46:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:46:40.492993 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:39289
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:42665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:39289
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:40.575603 16894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:40.575796 16894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:40.575817 16894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:40.576897 16894 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:46:40.576932 16894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:40.576946 16894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:40.576958 16894 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:46:40.576970 16894 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:46:40.578454 16894 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:42665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:39289
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:39289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16894
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:40.578644 16894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:40.578812 16894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:40.583827 16907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:40.583827 16900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:40.583871 16894 server_base.cc:1034] running on GCE node
W20260809 18:46:40.584197 16899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:40.584502 16894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:40.584805 16894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:40.585986 16894 hybrid_clock.cc:648] HybridClock initialized: now 1786301200585982 us; error 39 us; skew 500 ppm
Aug 09 18:46:40 dist-test-slave-45dx krb5kdc[16869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301200, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:40.588501 16894 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:46:40.588924 16894 webserver.cc:460] Webserver started at http://127.12.202.254:44205/ using document root <none> and password file <none>
I20260809 18:46:40.589170 16894 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:40.589238 16894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:40.589385 16894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:40.590412 16894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "8c37517dcc1b4b028c49ba4c96a93a77"
format_stamp: "Formatted at 2026-08-09 18:46:40 on dist-test-slave-45dx"
server_key: "f4c225ae8f3a1da5629bf84f0a56d8ef"
server_key_iv: "f5a00099e04f7e3d173ee3ed5345255f"
server_key_version: "encryptionkey@0"
I20260809 18:46:40.590762 16894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "8c37517dcc1b4b028c49ba4c96a93a77"
format_stamp: "Formatted at 2026-08-09 18:46:40 on dist-test-slave-45dx"
server_key: "f4c225ae8f3a1da5629bf84f0a56d8ef"
server_key_iv: "f5a00099e04f7e3d173ee3ed5345255f"
server_key_version: "encryptionkey@0"
I20260809 18:46:40.592104 16894 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 18:46:40.592900 16920 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:40.593061 16894 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:40.593160 16894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "8c37517dcc1b4b028c49ba4c96a93a77"
format_stamp: "Formatted at 2026-08-09 18:46:40 on dist-test-slave-45dx"
server_key: "f4c225ae8f3a1da5629bf84f0a56d8ef"
server_key_iv: "f5a00099e04f7e3d173ee3ed5345255f"
server_key_version: "encryptionkey@0"
I20260809 18:46:40.593240 16894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:40.602677 16894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:40.604492 16894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:40.604655 16894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:40.608764 16894 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:39289
I20260809 18:46:40.608808 17003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:39289 every 8 connection(s)
I20260809 18:46:40.609181 16894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:46:40.610074 17006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:40.612375 17006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77: Bootstrap starting.
I20260809 18:46:40.612932 17006 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:40.613168 17006 log.cc:824] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:40.613830 17006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77: No bootstrap required, opened a new log
I20260809 18:46:40.615348 17006 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c37517dcc1b4b028c49ba4c96a93a77" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39289 } }
I20260809 18:46:40.615486 17006 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:40.615509 17006 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c37517dcc1b4b028c49ba4c96a93a77, State: Initialized, Role: FOLLOWER
I20260809 18:46:40.615648 17006 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c37517dcc1b4b028c49ba4c96a93a77" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39289 } }
I20260809 18:46:40.615734 17006 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:46:40.615758 17006 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:46:40.615789 17006 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:40.616385 17006 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c37517dcc1b4b028c49ba4c96a93a77" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39289 } }
I20260809 18:46:40.616473 17006 leader_election.cc:302] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c37517dcc1b4b028c49ba4c96a93a77; no voters:
I20260809 18:46:40.616595 17006 leader_election.cc:288] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:46:40.616676 17012 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:40.616842 17012 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77 [term 1 LEADER]: Becoming Leader. State: Replica: 8c37517dcc1b4b028c49ba4c96a93a77, State: Running, Role: LEADER
I20260809 18:46:40.616896 17006 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:40.616932 17012 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c37517dcc1b4b028c49ba4c96a93a77" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39289 } }
I20260809 18:46:40.617287 17013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c37517dcc1b4b028c49ba4c96a93a77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c37517dcc1b4b028c49ba4c96a93a77" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39289 } } }
I20260809 18:46:40.617390 17013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77 [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:40.617425 17014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c37517dcc1b4b028c49ba4c96a93a77. Latest consensus state: current_term: 1 leader_uuid: "8c37517dcc1b4b028c49ba4c96a93a77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c37517dcc1b4b028c49ba4c96a93a77" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39289 } } }
I20260809 18:46:40.617486 17014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77 [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:40.618126 17022 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:46:40.618738 17022 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:46:40.618762 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 16894
I20260809 18:46:40.618865 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:46:40.619033 13099 external_mini_cluster.cc:1428] Setting key dee80f84a510378f48b1d265207cf2c5
I20260809 18:46:40.620328 17022 catalog_manager.cc:1347] Generated new cluster ID: f5c72749167547c2bb8c3d98674acf79
I20260809 18:46:40.620390 17022 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:46:40 dist-test-slave-45dx krb5kdc[16869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301200, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:40.630928 17044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:40.619503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35734 (local address 127.12.202.254:39289)
0809 18:46:40.619683 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:40.619691 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:40.619727 (+ 36us) server_negotiation.cc:407] Connection header received
0809 18:46:40.620030 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:40.620037 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:40.620095 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:40.621111 (+ 1016us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:40.621206 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:40.622654 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:40.623718 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:40.624348 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:40.624469 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:40.627244 (+ 2775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:40.627248 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:40.627248 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:40.627261 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:40.629250 (+ 1989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:40.629662 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:40.629664 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:40.629665 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:40.629770 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:40.629982 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:40.629982 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:40.629982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:40.630300 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:40.630463 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:40.630567 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 18:46:40.630699 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":81,"threads_started":1}
I20260809 18:46:40.631641 17022 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:46:40.632356 17022 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:46:40.644945 17022 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c37517dcc1b4b028c49ba4c96a93a77: Generated new TSK 0
I20260809 18:46:40.645155 17022 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
I20260809 18:46:40.677260 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39289
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:42665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:40.787842 17053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:40.788058 17053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:40.788084 17053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:40.789319 17053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:40.789361 17053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:40.789394 17053 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:46:40.790835 17053 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:42665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:40.791028 17053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:40.791229 17053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:40.796463 17065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:40.796540 17062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:40.796461 17061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:40.796643 17053 server_base.cc:1034] running on GCE node
I20260809 18:46:40.796921 17053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:40.797212 17053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:40.798354 17053 hybrid_clock.cc:648] HybridClock initialized: now 1786301200798344 us; error 29 us; skew 500 ppm
Aug 09 18:46:40 dist-test-slave-45dx krb5kdc[16869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301200, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:40.800987 17053 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:46:40.801456 17053 webserver.cc:460] Webserver started at http://127.12.202.193:40673/ using document root <none> and password file <none>
I20260809 18:46:40.801707 17053 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:40.801765 17053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:40.801954 17053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:40.803046 17053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "10c4f1ed77704545914d579238d194bd"
format_stamp: "Formatted at 2026-08-09 18:46:40 on dist-test-slave-45dx"
server_key: "0ad7a35ce186c4f30c48bb0c90cc8587"
server_key_iv: "ab465392acb6b07d8de79d6a7f842230"
server_key_version: "encryptionkey@0"
I20260809 18:46:40.803438 17053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "10c4f1ed77704545914d579238d194bd"
format_stamp: "Formatted at 2026-08-09 18:46:40 on dist-test-slave-45dx"
server_key: "0ad7a35ce186c4f30c48bb0c90cc8587"
server_key_iv: "ab465392acb6b07d8de79d6a7f842230"
server_key_version: "encryptionkey@0"
I20260809 18:46:40.804888 17053 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:46:40.805620 17075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:40.805811 17053 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:46:40.805904 17053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "10c4f1ed77704545914d579238d194bd"
format_stamp: "Formatted at 2026-08-09 18:46:40 on dist-test-slave-45dx"
server_key: "0ad7a35ce186c4f30c48bb0c90cc8587"
server_key_iv: "ab465392acb6b07d8de79d6a7f842230"
server_key_version: "encryptionkey@0"
I20260809 18:46:40.805962 17053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:40.820787 17053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:40.822890 17053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:40.823058 17053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:40.823258 17053 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:40.823520 17053 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:40.823551 17053 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:40.823573 17053 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:40.823585 17053 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:40.829528 17053 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:38575
I20260809 18:46:40.829608 17260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:38575 every 8 connection(s)
I20260809 18:46:40.829933 17053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:46:40.833209 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 17053
I20260809 18:46:40.833316 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:46:40.833493 13099 external_mini_cluster.cc:1428] Setting key 20fd8976cbaceed926629126bae6afad
Aug 09 18:46:40 dist-test-slave-45dx krb5kdc[16869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301200, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:40.840618 17044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:40.830703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:54241 (local address 127.12.202.254:39289)
0809 18:46:40.830760 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:40.830762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:40.830989 (+ 227us) server_negotiation.cc:407] Connection header received
0809 18:46:40.831461 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:40.831462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:40.831472 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:40.831521 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:40.832544 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:40.833095 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:40.834513 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:40.834712 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:40.834766 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:40.837542 (+ 2776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:40.837544 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:40.837544 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:40.837552 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:40.839216 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:40.839606 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:40.839607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:40.839608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:40.839676 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:40.839912 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:40.839913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:40.839913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:40.840066 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:40.840150 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:40.840435 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 18:46:40.840525 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:46:40.840801 17263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:40.830676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:39289 (local address 127.12.202.193:54241)
0809 18:46:40.830866 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:40.830902 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:40.831377 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:40.831580 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:40.831584 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:40.832178 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:40.832452 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:40.832459 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:40.833196 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:40.833197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:40.834425 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:40.834428 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:40.834799 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:40.834800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:40.834948 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:40.835451 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:40.835461 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:40.837427 (+ 1966us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:40.839297 (+ 1870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:40.839303 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:40.839305 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:40.839525 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:40.839745 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:40.839745 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:40.839746 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:40.839842 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:40.840140 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:40.840145 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:40.840250 (+ 105us) client_negotiation.cc:769] Sending connection context
0809 18:46:40.840410 (+ 160us) client_negotiation.cc:240] Negotiation successful
0809 18:46:40.840569 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":98,"threads_started":1}
I20260809 18:46:40.841419 17261 heartbeater.cc:347] Connected to a master server at 127.12.202.254:39289
I20260809 18:46:40.841511 17261 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:40.841718 17261 heartbeater.cc:511] Master 127.12.202.254:39289 requested a full tablet report, sending...
I20260809 18:46:40.842321 16951 ts_manager.cc:194] Registered new tserver with Master: 10c4f1ed77704545914d579238d194bd (127.12.202.193:38575)
I20260809 18:46:40.843266 16951 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:54241
WARNING: no policy specified for kudu/127.12.202.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
I20260809 18:46:40.861507 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39289
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:42665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:40.944566 17270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:40.944757 17270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:40.944780 17270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:40.945984 17270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:40.946026 17270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:40.946053 17270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:46:40.947541 17270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:42665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:40.947805 17270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:40.948067 17270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:40.953199 17278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:40.953253 17277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:40.953244 17280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:40.953286 17270 server_base.cc:1034] running on GCE node
I20260809 18:46:40.953593 17270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:40.953855 17270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:40.955024 17270 hybrid_clock.cc:648] HybridClock initialized: now 1786301200955015 us; error 40 us; skew 500 ppm
Aug 09 18:46:40 dist-test-slave-45dx krb5kdc[16869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301200, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:40.957558 17270 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:46:40.958051 17270 webserver.cc:460] Webserver started at http://127.12.202.194:45381/ using document root <none> and password file <none>
I20260809 18:46:40.958304 17270 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:40.958379 17270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:40.958529 17270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:40.959578 17270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "3bda24f9709f42e98c80efca8a8f7da2"
format_stamp: "Formatted at 2026-08-09 18:46:40 on dist-test-slave-45dx"
server_key: "d566120205b59e29ff1a49b5355b0ade"
server_key_iv: "5fb8ece670bd831283c19ea1e12bf1d4"
server_key_version: "encryptionkey@0"
I20260809 18:46:40.959950 17270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "3bda24f9709f42e98c80efca8a8f7da2"
format_stamp: "Formatted at 2026-08-09 18:46:40 on dist-test-slave-45dx"
server_key: "d566120205b59e29ff1a49b5355b0ade"
server_key_iv: "5fb8ece670bd831283c19ea1e12bf1d4"
server_key_version: "encryptionkey@0"
I20260809 18:46:40.961366 17270 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:46:40.962092 17288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:40.962271 17270 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:40.962378 17270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "3bda24f9709f42e98c80efca8a8f7da2"
format_stamp: "Formatted at 2026-08-09 18:46:40 on dist-test-slave-45dx"
server_key: "d566120205b59e29ff1a49b5355b0ade"
server_key_iv: "5fb8ece670bd831283c19ea1e12bf1d4"
server_key_version: "encryptionkey@0"
I20260809 18:46:40.962459 17270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:40.969570 17270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:40.971437 17270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:40.971601 17270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:40.971819 17270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:40.972131 17270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:40.972188 17270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:40.972229 17270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:40.972256 17270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:40.978308 17270 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:42641
I20260809 18:46:40.978364 17479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:42641 every 8 connection(s)
I20260809 18:46:40.978652 17270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
Aug 09 18:46:40 dist-test-slave-45dx krb5kdc[16869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301200, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:40.986902 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 17270
I20260809 18:46:40.987012 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:46:40.987214 13099 external_mini_cluster.cc:1428] Setting key ff4c38282f9fb403d530639f1f7120f4
I20260809 18:46:40.988458 17044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:40.979361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:33721 (local address 127.12.202.254:39289)
0809 18:46:40.979459 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:40.979461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:40.979607 (+ 146us) server_negotiation.cc:407] Connection header received
0809 18:46:40.980149 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:40.980150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:40.980164 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:40.980214 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:40.981185 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:40.981673 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:40.982691 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:40.982913 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:40.983012 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:40.985203 (+ 2191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:40.985205 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:40.985205 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:40.985213 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:40.986637 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:40.987291 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:40.987292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:40.987293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:40.987362 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:40.987693 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:40.987694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:40.987694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:40.987851 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:40.987924 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:40.988272 (+ 348us) server_negotiation.cc:299] Negotiation successful
0809 18:46:40.988395 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 18:46:40.988729 17484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:40.979298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:39289 (local address 127.12.202.194:33721)
0809 18:46:40.979489 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:40.979529 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:40.980039 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:40.980282 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:40.980285 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:40.980897 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:40.981089 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:40.981094 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:40.981813 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:40.981814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:40.982596 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:40.982598 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:40.983024 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:40.983025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:40.983141 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:40.983674 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:40.983682 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:40.985089 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:40.986788 (+ 1699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:40.986797 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:40.986799 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:40.987176 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:40.987451 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:40.987452 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:40.987453 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:40.987595 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:40.987917 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:40.987951 (+ 34us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:40.988125 (+ 174us) client_negotiation.cc:769] Sending connection context
0809 18:46:40.988246 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 18:46:40.988462 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":100,"threads_started":1}
I20260809 18:46:40.989231 17482 heartbeater.cc:347] Connected to a master server at 127.12.202.254:39289
I20260809 18:46:40.989351 17482 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:40.989559 17482 heartbeater.cc:511] Master 127.12.202.254:39289 requested a full tablet report, sending...
I20260809 18:46:40.989944 16951 ts_manager.cc:194] Registered new tserver with Master: 3bda24f9709f42e98c80efca8a8f7da2 (127.12.202.194:42641)
I20260809 18:46:40.990325 16951 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:33721
WARNING: no policy specified for kudu/127.12.202.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
I20260809 18:46:41.014979 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39289
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:42665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:41.100797 17489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:41.101007 17489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:41.101030 17489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:41.102144 17489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:41.102182 17489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:41.102207 17489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:46:41.103571 17489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:42665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:41.103765 17489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:41.103937 17489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:41.109028 17502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:41.109189 17489 server_base.cc:1034] running on GCE node
W20260809 18:46:41.109004 17498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:41.109059 17497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:41.109483 17489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:41.109771 17489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:41.110937 17489 hybrid_clock.cc:648] HybridClock initialized: now 1786301201110929 us; error 33 us; skew 500 ppm
Aug 09 18:46:41 dist-test-slave-45dx krb5kdc[16869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301201, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:41.113521 17489 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:46:41.113993 17489 webserver.cc:460] Webserver started at http://127.12.202.195:38679/ using document root <none> and password file <none>
I20260809 18:46:41.114207 17489 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:41.114269 17489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:41.114434 17489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:41.115464 17489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "37e0aeee742a4137aca71c7b7b907c0e"
format_stamp: "Formatted at 2026-08-09 18:46:41 on dist-test-slave-45dx"
server_key: "34f81999ea58badbc9d4992b77a07b8f"
server_key_iv: "928ec6d5295a13302941b302889ba26a"
server_key_version: "encryptionkey@0"
I20260809 18:46:41.115830 17489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "37e0aeee742a4137aca71c7b7b907c0e"
format_stamp: "Formatted at 2026-08-09 18:46:41 on dist-test-slave-45dx"
server_key: "34f81999ea58badbc9d4992b77a07b8f"
server_key_iv: "928ec6d5295a13302941b302889ba26a"
server_key_version: "encryptionkey@0"
I20260809 18:46:41.117415 17489 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:46:41.118244 17512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:41.118566 17489 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:41.118667 17489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "37e0aeee742a4137aca71c7b7b907c0e"
format_stamp: "Formatted at 2026-08-09 18:46:41 on dist-test-slave-45dx"
server_key: "34f81999ea58badbc9d4992b77a07b8f"
server_key_iv: "928ec6d5295a13302941b302889ba26a"
server_key_version: "encryptionkey@0"
I20260809 18:46:41.118749 17489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:41.141204 17489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:41.143666 17489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:41.143851 17489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:41.144101 17489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:41.144475 17489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:41.144529 17489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:41.144572 17489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:41.144598 17489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:41.151110 17489 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:38353
I20260809 18:46:41.151154 17696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:38353 every 8 connection(s)
I20260809 18:46:41.151494 17489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:46:41 dist-test-slave-45dx krb5kdc[16869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301201, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:41.160260 17044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:41.152232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:33345 (local address 127.12.202.254:39289)
0809 18:46:41.152316 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:41.152319 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:41.152532 (+ 213us) server_negotiation.cc:407] Connection header received
0809 18:46:41.153012 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:41.153013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:41.153024 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:41.153075 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:41.153959 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:41.154428 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:41.155336 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:41.155512 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:41.155560 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:41.157693 (+ 2133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:41.157695 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:41.157695 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:41.157702 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:41.159169 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:41.159517 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:41.159518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:41.159518 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:41.159570 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:41.159773 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:41.159774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:41.159774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:41.159868 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:41.159918 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:41.160133 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 18:46:41.160198 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 18:46:41.160457 17701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:41.152211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:39289 (local address 127.12.202.195:33345)
0809 18:46:41.152425 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:41.152464 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:41.152928 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:41.153128 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:41.153131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:41.153693 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:41.153882 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:41.153887 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:41.154507 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:41.154508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:41.155262 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:41.155264 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:41.155586 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:41.155586 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:41.155680 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:41.156141 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:41.156149 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:41.157608 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:41.159235 (+ 1627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:41.159241 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:41.159242 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:41.159453 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:41.159627 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:41.159627 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:41.159627 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:41.159721 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:41.159922 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:41.159926 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:41.160028 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 18:46:41.160106 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 18:46:41.160214 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":134,"threads_started":1}
I20260809 18:46:41.160648 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 17489
I20260809 18:46:41.160763 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:46:41.160983 13099 external_mini_cluster.cc:1428] Setting key 1ed233b3c07290f1e3feb3015d8a51a5
I20260809 18:46:41.161015 17697 heartbeater.cc:347] Connected to a master server at 127.12.202.254:39289
I20260809 18:46:41.161141 17697 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:41.161345 17697 heartbeater.cc:511] Master 127.12.202.254:39289 requested a full tablet report, sending...
I20260809 18:46:41.161731 16949 ts_manager.cc:194] Registered new tserver with Master: 37e0aeee742a4137aca71c7b7b907c0e (127.12.202.195:38353)
I20260809 18:46:41.162134 16949 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:33345
I20260809 18:46:41.172811 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 18:46:41.185752 17044 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:46:41.184773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35738 (local address 127.12.202.254:39289)
0809 18:46:41.184836 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:41.184838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:41.184994 (+ 156us) server_negotiation.cc:407] Connection header received
0809 18:46:41.185051 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:41.185052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:41.185061 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:41.185122 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:41.185657 (+ 535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35738: BlockingRecv error: recv got EOF from 127.0.0.1:35738 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 18:46:41.186714 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 17053
I20260809 18:46:41.198552 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 17270
I20260809 18:46:41.215433 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 17489
I20260809 18:46:41.225442 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 16894
2026-08-09T18:46:41Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2152 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:46:41 dist-test-slave-45dx krb5kdc[17716](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:46:41 dist-test-slave-45dx krb5kdc[17716](info): set up 2 sockets
Aug 09 18:46:41 dist-test-slave-45dx krb5kdc[17716](info): commencing operation
krb5kdc: starting...
W20260809 18:46:42.485662 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:46:42 dist-test-slave-45dx krb5kdc[17716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301202, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:46:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:46:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:46:42.610742 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:34745
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:42881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:34745
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:42.692472 17734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:42.692677 17734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:42.692699 17734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:42.693887 17734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:46:42.693928 17734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:42.693941 17734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:42.693954 17734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:46:42.693966 17734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:46:42.695571 17734 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:42881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:34745
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:34745
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:42.695842 17734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:42.696107 17734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:42.701010 17742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:42.701020 17740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:42.701134 17734 server_base.cc:1034] running on GCE node
W20260809 18:46:42.701215 17745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:42.701465 17734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:42.701722 17734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:42.702888 17734 hybrid_clock.cc:648] HybridClock initialized: now 1786301202702868 us; error 46 us; skew 500 ppm
Aug 09 18:46:42 dist-test-slave-45dx krb5kdc[17716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301202, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:42.710486 17734 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:46:42.711009 17734 webserver.cc:460] Webserver started at http://127.12.202.254:42795/ using document root <none> and password file <none>
I20260809 18:46:42.711236 17734 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:42.711304 17734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:42.711462 17734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:42.712595 17734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "0abb9c5840e044fd964e61e479bcefa4"
format_stamp: "Formatted at 2026-08-09 18:46:42 on dist-test-slave-45dx"
server_key: "a1be8b0beaa1648815680860581d2787"
server_key_iv: "b077ea07a6a2b6d0b983e4afe786ea1d"
server_key_version: "encryptionkey@0"
I20260809 18:46:42.712965 17734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "0abb9c5840e044fd964e61e479bcefa4"
format_stamp: "Formatted at 2026-08-09 18:46:42 on dist-test-slave-45dx"
server_key: "a1be8b0beaa1648815680860581d2787"
server_key_iv: "b077ea07a6a2b6d0b983e4afe786ea1d"
server_key_version: "encryptionkey@0"
I20260809 18:46:42.714288 17734 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:46:42.715010 17755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:42.715186 17734 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:42.715296 17734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "0abb9c5840e044fd964e61e479bcefa4"
format_stamp: "Formatted at 2026-08-09 18:46:42 on dist-test-slave-45dx"
server_key: "a1be8b0beaa1648815680860581d2787"
server_key_iv: "b077ea07a6a2b6d0b983e4afe786ea1d"
server_key_version: "encryptionkey@0"
I20260809 18:46:42.715370 17734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:42.744019 17734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:42.746364 17734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:42.746537 17734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:42.750921 17734 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:34745
I20260809 18:46:42.750963 17838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:34745 every 8 connection(s)
I20260809 18:46:42.751561 17734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:46:42.752279 17839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:42.754745 17839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4: Bootstrap starting.
I20260809 18:46:42.755374 17839 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:42.755707 17839 log.cc:824] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:42.756289 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 17734
I20260809 18:46:42.756431 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:46:42.756557 17839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4: No bootstrap required, opened a new log
I20260809 18:46:42.756618 13099 external_mini_cluster.cc:1428] Setting key 8b94a121c08b4ea23f42224a72370dad
I20260809 18:46:42.759465 17839 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0abb9c5840e044fd964e61e479bcefa4" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 34745 } }
I20260809 18:46:42.759629 17839 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:42.759680 17839 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0abb9c5840e044fd964e61e479bcefa4, State: Initialized, Role: FOLLOWER
I20260809 18:46:42.759815 17839 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0abb9c5840e044fd964e61e479bcefa4" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 34745 } }
I20260809 18:46:42.759903 17839 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:46:42.759953 17839 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:46:42.760013 17839 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:42.760725 17839 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0abb9c5840e044fd964e61e479bcefa4" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 34745 } }
I20260809 18:46:42.760834 17839 leader_election.cc:302] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0abb9c5840e044fd964e61e479bcefa4; no voters:
I20260809 18:46:42.761018 17839 leader_election.cc:288] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:46:42.761076 17845 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:42.761245 17845 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4 [term 1 LEADER]: Becoming Leader. State: Replica: 0abb9c5840e044fd964e61e479bcefa4, State: Running, Role: LEADER
I20260809 18:46:42.761276 17839 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:42.761384 17845 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0abb9c5840e044fd964e61e479bcefa4" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 34745 } }
I20260809 18:46:42.761698 17849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0abb9c5840e044fd964e61e479bcefa4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0abb9c5840e044fd964e61e479bcefa4" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 34745 } } }
I20260809 18:46:42.761790 17849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4 [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:42.762089 17851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0abb9c5840e044fd964e61e479bcefa4. Latest consensus state: current_term: 1 leader_uuid: "0abb9c5840e044fd964e61e479bcefa4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0abb9c5840e044fd964e61e479bcefa4" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 34745 } } }
I20260809 18:46:42.762220 17851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4 [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:42.762362 17859 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:46:42.762926 17859 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 18:46:42 dist-test-slave-45dx krb5kdc[17716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301202, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:42.765262 17859 catalog_manager.cc:1347] Generated new cluster ID: d8a5df1586a6483f9831408cd5658ab6
I20260809 18:46:42.765306 17859 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:46:42.768451 17844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:42.757148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34292 (local address 127.12.202.254:34745)
0809 18:46:42.757354 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:42.757362 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:42.757393 (+ 31us) server_negotiation.cc:407] Connection header received
0809 18:46:42.757916 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:42.757923 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:42.757969 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:42.758079 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:42.758924 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:42.759862 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:42.761012 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:42.761668 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:42.761821 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:42.764672 (+ 2851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:42.764676 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:42.764676 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:42.764688 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:42.766754 (+ 2066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:42.767165 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:42.767168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:42.767169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:42.767298 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:42.767510 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:42.767511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:42.767511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:42.767826 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:42.767990 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:42.768063 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 18:46:42.768204 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":143,"thread_start_us":104,"threads_started":1}
I20260809 18:46:42.769645 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:46:42.788407 17859 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:46:42.788990 17859 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:46:42.789855 17844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:42.785061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34294 (local address 127.12.202.254:34745)
0809 18:46:42.785106 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:42.785108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:42.785280 (+ 172us) server_negotiation.cc:407] Connection header received
0809 18:46:42.785349 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:42.785350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:42.785362 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:42.785420 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:42.785860 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:42.786622 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:42.787716 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:42.787997 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:42.788071 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:42.789331 (+ 1260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:42.789332 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:42.789332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:46:42.789557 (+ 225us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:42.789575 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:46:42.789583 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:42.789641 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:42.789731 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 18:46:42.789778 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:46:42.798277 17859 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0abb9c5840e044fd964e61e479bcefa4: Generated new TSK 0
I20260809 18:46:42.798498 17859 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:46:42.805824 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 17734
2026-08-09T18:46:42Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1579 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:46:42 dist-test-slave-45dx krb5kdc[17894](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:46:42 dist-test-slave-45dx krb5kdc[17894](info): set up 2 sockets
Aug 09 18:46:42 dist-test-slave-45dx krb5kdc[17894](info): commencing operation
krb5kdc: starting...
W20260809 18:46:44.080178 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:46:44 dist-test-slave-45dx krb5kdc[17894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301204, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:46:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:46:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:46:44.201346 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:42269
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:36337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:42269
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:44.286856 17917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:44.287075 17917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:44.287104 17917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:44.288292 17917 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:46:44.288400 17917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:44.288416 17917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:44.288465 17917 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:46:44.288491 17917 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:46:44.290060 17917 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:36337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:42269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:42269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:44.290323 17917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:44.290573 17917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:44.295634 17931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:44.295756 17917 server_base.cc:1034] running on GCE node
W20260809 18:46:44.295621 17936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:44.295727 17932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:44.296164 17917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:44.296489 17917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:44.297638 17917 hybrid_clock.cc:648] HybridClock initialized: now 1786301204297614 us; error 39 us; skew 500 ppm
Aug 09 18:46:44 dist-test-slave-45dx krb5kdc[17894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301204, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:44.300052 17917 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:46:44.300549 17917 webserver.cc:460] Webserver started at http://127.12.202.254:44177/ using document root <none> and password file <none>
I20260809 18:46:44.300781 17917 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:44.300848 17917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:44.300997 17917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:44.302111 17917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "5c5c89550e634beab73b9aff4fdaf21d"
format_stamp: "Formatted at 2026-08-09 18:46:44 on dist-test-slave-45dx"
server_key: "8158aec425181da2ae056bbd869884cb"
server_key_iv: "cd86d11c2c14453828b81ac7d37ef523"
server_key_version: "encryptionkey@0"
I20260809 18:46:44.302506 17917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "5c5c89550e634beab73b9aff4fdaf21d"
format_stamp: "Formatted at 2026-08-09 18:46:44 on dist-test-slave-45dx"
server_key: "8158aec425181da2ae056bbd869884cb"
server_key_iv: "cd86d11c2c14453828b81ac7d37ef523"
server_key_version: "encryptionkey@0"
I20260809 18:46:44.303879 17917 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:46:44.304723 17944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:44.304919 17917 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:46:44.305027 17917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "5c5c89550e634beab73b9aff4fdaf21d"
format_stamp: "Formatted at 2026-08-09 18:46:44 on dist-test-slave-45dx"
server_key: "8158aec425181da2ae056bbd869884cb"
server_key_iv: "cd86d11c2c14453828b81ac7d37ef523"
server_key_version: "encryptionkey@0"
I20260809 18:46:44.305104 17917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:44.318300 17917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:44.320163 17917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:44.320397 17917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:44.324504 17917 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:42269
I20260809 18:46:44.324570 18033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:42269 every 8 connection(s)
I20260809 18:46:44.324939 17917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:46:44.326270 18034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:44.326536 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 17917
I20260809 18:46:44.326642 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:46:44.326897 13099 external_mini_cluster.cc:1428] Setting key ab7284ee0f323788842f4197acb2aee1
I20260809 18:46:44.329349 18034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d: Bootstrap starting.
I20260809 18:46:44.330153 18034 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:44.330511 18034 log.cc:824] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:44.331439 18034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d: No bootstrap required, opened a new log
I20260809 18:46:44.334033 18034 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5c89550e634beab73b9aff4fdaf21d" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42269 } }
I20260809 18:46:44.334242 18034 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:44.334281 18034 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c5c89550e634beab73b9aff4fdaf21d, State: Initialized, Role: FOLLOWER
I20260809 18:46:44.334430 18034 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5c89550e634beab73b9aff4fdaf21d" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42269 } }
I20260809 18:46:44.334543 18034 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:46:44.334595 18034 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:46:44.334649 18034 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d [term 0 FOLLOWER]: Advancing to term 1
Aug 09 18:46:44 dist-test-slave-45dx krb5kdc[17894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301204, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:44.335454 18034 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5c89550e634beab73b9aff4fdaf21d" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42269 } }
I20260809 18:46:44.335585 18034 leader_election.cc:302] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c5c89550e634beab73b9aff4fdaf21d; no voters:
I20260809 18:46:44.335799 18034 leader_election.cc:288] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:46:44.335997 18041 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:44.336202 18034 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:44.336326 18041 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d [term 1 LEADER]: Becoming Leader. State: Replica: 5c5c89550e634beab73b9aff4fdaf21d, State: Running, Role: LEADER
I20260809 18:46:44.336498 18041 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5c89550e634beab73b9aff4fdaf21d" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42269 } }
I20260809 18:46:44.336869 18041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c5c89550e634beab73b9aff4fdaf21d. Latest consensus state: current_term: 1 leader_uuid: "5c5c89550e634beab73b9aff4fdaf21d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5c89550e634beab73b9aff4fdaf21d" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42269 } } }
I20260809 18:46:44.337306 18041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:44.337226 18044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c5c89550e634beab73b9aff4fdaf21d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5c89550e634beab73b9aff4fdaf21d" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42269 } } }
I20260809 18:46:44.337529 18044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:44.337550 18057 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:46:44.338152 18057 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:46:44.340711 18057 catalog_manager.cc:1347] Generated new cluster ID: 7fa3e39d2a13469fbf5dc344e73a4b5f
I20260809 18:46:44.340766 18057 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:46:44.340781 18039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:44.327479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57780 (local address 127.12.202.254:42269)
0809 18:46:44.327669 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:44.327676 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:44.328546 (+ 870us) server_negotiation.cc:407] Connection header received
0809 18:46:44.329049 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:44.329057 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:44.329105 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:44.329221 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:44.330069 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:44.331230 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:44.332354 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:44.332769 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:44.332851 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:44.335991 (+ 3140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:44.335996 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:44.335996 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:44.336010 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:44.338757 (+ 2747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:44.339211 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:44.339214 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:44.339214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:44.339342 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:44.339597 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:44.339598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:44.339598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:44.339913 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:44.340060 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:44.340421 (+ 361us) server_negotiation.cc:299] Negotiation successful
0809 18:46:44.340580 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":86,"threads_started":1}
I20260809 18:46:44.367657 18057 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:46:44.368531 18057 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:46:44.372690 18057 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c5c89550e634beab73b9aff4fdaf21d: Generated new TSK 0
I20260809 18:46:44.372921 18057 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
I20260809 18:46:44.402860 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42269
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:36337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:44.486414 18080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:44.486667 18080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:44.486706 18080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:44.487864 18080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:44.487932 18080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:44.487973 18080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:46:44.489414 18080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:36337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:44.489691 18080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:44.489929 18080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:44.495153 18086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:44.495152 18089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:44.495164 18087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:44.495457 18080 server_base.cc:1034] running on GCE node
I20260809 18:46:44.495673 18080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:44.495973 18080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:44.497114 18080 hybrid_clock.cc:648] HybridClock initialized: now 1786301204497082 us; error 46 us; skew 500 ppm
Aug 09 18:46:44 dist-test-slave-45dx krb5kdc[17894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301204, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:44.499644 18080 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:46:44.500046 18080 webserver.cc:460] Webserver started at http://127.12.202.193:37905/ using document root <none> and password file <none>
I20260809 18:46:44.500247 18080 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:44.500288 18080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:44.500485 18080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:44.501562 18080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "9ca462a49c3645548a4c4398f725ac21"
format_stamp: "Formatted at 2026-08-09 18:46:44 on dist-test-slave-45dx"
server_key: "12cc869906fbd4e59ad2ae7df8c8d229"
server_key_iv: "b45b7733ae1bdce3205e23ca0b2f3f08"
server_key_version: "encryptionkey@0"
I20260809 18:46:44.501904 18080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "9ca462a49c3645548a4c4398f725ac21"
format_stamp: "Formatted at 2026-08-09 18:46:44 on dist-test-slave-45dx"
server_key: "12cc869906fbd4e59ad2ae7df8c8d229"
server_key_iv: "b45b7733ae1bdce3205e23ca0b2f3f08"
server_key_version: "encryptionkey@0"
I20260809 18:46:44.503198 18080 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:46:44.503927 18103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:44.504088 18080 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:44.504181 18080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "9ca462a49c3645548a4c4398f725ac21"
format_stamp: "Formatted at 2026-08-09 18:46:44 on dist-test-slave-45dx"
server_key: "12cc869906fbd4e59ad2ae7df8c8d229"
server_key_iv: "b45b7733ae1bdce3205e23ca0b2f3f08"
server_key_version: "encryptionkey@0"
I20260809 18:46:44.504253 18080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:44.514755 18080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:44.516630 18080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:44.516742 18080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:44.516942 18080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:44.517310 18080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:44.517346 18080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:44.517397 18080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:44.517423 18080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:44.523260 18080 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:39945
I20260809 18:46:44.523350 18291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:39945 every 8 connection(s)
I20260809 18:46:44.523674 18080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:46:44.528928 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 18080
I20260809 18:46:44.529052 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:46:44.529268 13099 external_mini_cluster.cc:1428] Setting key 38e6acb32cd1fecfb0f88457d2e2f803
Aug 09 18:46:44 dist-test-slave-45dx krb5kdc[17894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301204, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:44.533931 18039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:44.524479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:41733 (local address 127.12.202.254:42269)
0809 18:46:44.524544 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:44.524546 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:44.524782 (+ 236us) server_negotiation.cc:407] Connection header received
0809 18:46:44.525289 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:44.525290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:44.525301 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:44.525346 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:44.526318 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:44.526843 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:44.527843 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:44.528040 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:44.528091 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:44.530639 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:44.530640 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:44.530640 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:44.530648 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:44.532277 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:44.532872 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:44.532873 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:44.532873 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:44.532935 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:44.533231 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:44.533232 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:44.533232 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:44.533333 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:44.533414 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:44.533724 (+ 310us) server_negotiation.cc:299] Negotiation successful
0809 18:46:44.533820 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 18:46:44.534124 18295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:44.524441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42269 (local address 127.12.202.193:41733)
0809 18:46:44.524647 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:44.524691 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:44.525188 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:44.525400 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:44.525403 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:44.526029 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:44.526225 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:44.526230 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:44.526932 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:44.526932 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:44.527765 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:44.527767 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:44.528115 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:44.528116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:44.528218 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:44.528860 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:44.528868 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:44.530550 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:44.532418 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:44.532427 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:44.532429 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:44.532790 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:44.533001 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:44.533003 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:44.533003 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:44.533162 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:44.533412 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:44.533420 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:44.533563 (+ 143us) client_negotiation.cc:769] Sending connection context
0809 18:46:44.533694 (+ 131us) client_negotiation.cc:240] Negotiation successful
0809 18:46:44.533864 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":105,"threads_started":1}
I20260809 18:46:44.534713 18292 heartbeater.cc:347] Connected to a master server at 127.12.202.254:42269
I20260809 18:46:44.534842 18292 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:44.535069 18292 heartbeater.cc:511] Master 127.12.202.254:42269 requested a full tablet report, sending...
I20260809 18:46:44.535640 17970 ts_manager.cc:194] Registered new tserver with Master: 9ca462a49c3645548a4c4398f725ac21 (127.12.202.193:39945)
I20260809 18:46:44.536358 17970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:41733
WARNING: no policy specified for kudu/127.12.202.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
I20260809 18:46:44.559361 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42269
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:36337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:44.643460 18300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:44.643666 18300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:44.643702 18300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:44.644927 18300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:44.644971 18300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:44.644996 18300 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:46:44.646476 18300 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:36337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:44.646719 18300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:44.646986 18300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:44.652285 18309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:44.652369 18306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:44.652443 18300 server_base.cc:1034] running on GCE node
W20260809 18:46:44.652355 18307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:44.652722 18300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:44.653012 18300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:44.654187 18300 hybrid_clock.cc:648] HybridClock initialized: now 1786301204654160 us; error 37 us; skew 500 ppm
Aug 09 18:46:44 dist-test-slave-45dx krb5kdc[17894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301204, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:44.656968 18300 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:46:44.657457 18300 webserver.cc:460] Webserver started at http://127.12.202.194:43635/ using document root <none> and password file <none>
I20260809 18:46:44.657642 18300 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:44.657683 18300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:44.657773 18300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:44.658771 18300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "fd8e8727fa834d24839d8e0d37da0301"
format_stamp: "Formatted at 2026-08-09 18:46:44 on dist-test-slave-45dx"
server_key: "0fc6e9c53e99b5fb9022ce04e468735d"
server_key_iv: "c0264b57426f357855b64cefa28e0f7f"
server_key_version: "encryptionkey@0"
I20260809 18:46:44.659083 18300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "fd8e8727fa834d24839d8e0d37da0301"
format_stamp: "Formatted at 2026-08-09 18:46:44 on dist-test-slave-45dx"
server_key: "0fc6e9c53e99b5fb9022ce04e468735d"
server_key_iv: "c0264b57426f357855b64cefa28e0f7f"
server_key_version: "encryptionkey@0"
I20260809 18:46:44.660382 18300 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:46:44.661085 18325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:44.661238 18300 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:44.661325 18300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "fd8e8727fa834d24839d8e0d37da0301"
format_stamp: "Formatted at 2026-08-09 18:46:44 on dist-test-slave-45dx"
server_key: "0fc6e9c53e99b5fb9022ce04e468735d"
server_key_iv: "c0264b57426f357855b64cefa28e0f7f"
server_key_version: "encryptionkey@0"
I20260809 18:46:44.661374 18300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:44.685710 18300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:44.687714 18300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:44.687834 18300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:44.688052 18300 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:44.688380 18300 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:44.688419 18300 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:44.688443 18300 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:44.688457 18300 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:44.694301 18300 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:35989
I20260809 18:46:44.694398 18514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:35989 every 8 connection(s)
I20260809 18:46:44.694710 18300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:46:44.695055 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 18300
I20260809 18:46:44.695176 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:46:44.695395 13099 external_mini_cluster.cc:1428] Setting key 25ecc3ef14b39fd1ba08e42ece425977
Aug 09 18:46:44 dist-test-slave-45dx krb5kdc[17894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301204, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.202.195@KRBTEST.COM; defaulting to no policy
I20260809 18:46:44.705367 18039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:44.695499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:52363 (local address 127.12.202.254:42269)
0809 18:46:44.695584 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:44.695586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:44.695803 (+ 217us) server_negotiation.cc:407] Connection header received
0809 18:46:44.696469 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:44.696470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:44.696484 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:44.696555 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:44.697486 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:44.698188 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:44.699700 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:44.699874 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:44.699922 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:44.702491 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:44.702492 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:44.702493 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:44.702501 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:44.703815 (+ 1314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:44.704264 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:44.704266 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:44.704266 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:44.704386 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:44.704644 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:44.704645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:44.704645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:44.704760 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:44.704830 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:44.705175 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 18:46:44.705263 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 18:46:44.705583 18518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:44.695419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42269 (local address 127.12.202.194:52363)
0809 18:46:44.695667 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:44.695716 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:44.696356 (+ 640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:44.696610 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:44.696613 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:44.697197 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:44.697387 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:44.697392 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:44.698299 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:44.698300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:44.699618 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:44.699621 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:44.699955 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:44.699956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:44.700103 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:44.700629 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:44.700639 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:44.702373 (+ 1734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:44.703949 (+ 1576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:44.703957 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:44.703959 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:44.704186 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:44.704454 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:44.704455 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:44.704455 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:44.704569 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:44.704833 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:44.704841 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:44.705019 (+ 178us) client_negotiation.cc:769] Sending connection context
0809 18:46:44.705151 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 18:46:44.705316 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":91,"threads_started":1}
I20260809 18:46:44.706100 18516 heartbeater.cc:347] Connected to a master server at 127.12.202.254:42269
I20260809 18:46:44.706233 18516 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:44.706409 18516 heartbeater.cc:511] Master 127.12.202.254:42269 requested a full tablet report, sending...
I20260809 18:46:44.706732 17970 ts_manager.cc:194] Registered new tserver with Master: fd8e8727fa834d24839d8e0d37da0301 (127.12.202.194:35989)
I20260809 18:46:44.707111 17970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:52363
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
I20260809 18:46:44.721288 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42269
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:36337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:44.804467 18521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:44.804694 18521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:44.804718 18521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:44.805919 18521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:44.805967 18521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:44.805994 18521 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:46:44.807819 18521 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:36337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:44.808072 18521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:44.808339 18521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:44.813788 18536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:44.813800 18530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:44.813820 18521 server_base.cc:1034] running on GCE node
W20260809 18:46:44.813777 18529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:44.814240 18521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:44.814519 18521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:44.815688 18521 hybrid_clock.cc:648] HybridClock initialized: now 1786301204815684 us; error 37 us; skew 500 ppm
Aug 09 18:46:44 dist-test-slave-45dx krb5kdc[17894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301204, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:44.818333 18521 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:46:44.818789 18521 webserver.cc:460] Webserver started at http://127.12.202.195:38061/ using document root <none> and password file <none>
I20260809 18:46:44.819024 18521 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:44.819096 18521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:44.819255 18521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:44.820399 18521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "205253a484b14c7c86c675faad264c5c"
format_stamp: "Formatted at 2026-08-09 18:46:44 on dist-test-slave-45dx"
server_key: "5d07af89bb025af4434fe1e9dcf3f488"
server_key_iv: "eb588a0a7f7e52bc7de368f5451e7b18"
server_key_version: "encryptionkey@0"
I20260809 18:46:44.820775 18521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "205253a484b14c7c86c675faad264c5c"
format_stamp: "Formatted at 2026-08-09 18:46:44 on dist-test-slave-45dx"
server_key: "5d07af89bb025af4434fe1e9dcf3f488"
server_key_iv: "eb588a0a7f7e52bc7de368f5451e7b18"
server_key_version: "encryptionkey@0"
I20260809 18:46:44.822283 18521 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 18:46:44.823031 18545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:44.823201 18521 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:44.823309 18521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "205253a484b14c7c86c675faad264c5c"
format_stamp: "Formatted at 2026-08-09 18:46:44 on dist-test-slave-45dx"
server_key: "5d07af89bb025af4434fe1e9dcf3f488"
server_key_iv: "eb588a0a7f7e52bc7de368f5451e7b18"
server_key_version: "encryptionkey@0"
I20260809 18:46:44.823395 18521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:44.832587 18521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:44.834611 18521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:44.834784 18521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:44.835049 18521 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:44.835366 18521 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:44.835427 18521 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:44.835471 18521 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:44.835494 18521 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:44.842198 18521 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:33351
I20260809 18:46:44.842240 18754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:33351 every 8 connection(s)
I20260809 18:46:44.842602 18521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:46:44.846809 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 18521
I20260809 18:46:44.846916 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:46:44.847121 13099 external_mini_cluster.cc:1428] Setting key 772d85a3912870de6965cbc3f6d9dea2
Aug 09 18:46:44 dist-test-slave-45dx krb5kdc[17894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301204, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:44.851917 18039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:44.843436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:53851 (local address 127.12.202.254:42269)
0809 18:46:44.843505 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:44.843507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:44.843676 (+ 169us) server_negotiation.cc:407] Connection header received
0809 18:46:44.844158 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:44.844159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:44.844169 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:44.844227 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:44.845173 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:44.845699 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:44.846645 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:44.846831 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:44.846906 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:44.849388 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:44.849389 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:44.849390 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:44.849396 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:44.850854 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:44.851193 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:44.851194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:44.851194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:44.851245 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:44.851448 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:44.851448 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:44.851448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:44.851547 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:44.851596 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:44.851796 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 18:46:44.851855 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:46:44.852141 18757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:44.843396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42269 (local address 127.12.202.195:53851)
0809 18:46:44.843550 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:44.843591 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:44.844081 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:44.844276 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:44.844280 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:44.844907 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:44.845094 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:44.845099 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:44.845783 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:44.845784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:44.846562 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:44.846563 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:44.846936 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:44.846937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:44.847097 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:44.847712 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:44.847722 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:44.849303 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:44.850928 (+ 1625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:44.850933 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:44.850934 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:44.851132 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:44.851300 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:44.851301 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:44.851301 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:44.851395 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:44.851599 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:44.851603 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:44.851709 (+ 106us) client_negotiation.cc:769] Sending connection context
0809 18:46:44.851784 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 18:46:44.851907 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
I20260809 18:46:44.852675 18755 heartbeater.cc:347] Connected to a master server at 127.12.202.254:42269
I20260809 18:46:44.852757 18755 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:44.852887 18755 heartbeater.cc:511] Master 127.12.202.254:42269 requested a full tablet report, sending...
I20260809 18:46:44.853206 17970 ts_manager.cc:194] Registered new tserver with Master: 205253a484b14c7c86c675faad264c5c (127.12.202.195:33351)
I20260809 18:46:44.853607 17970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:53851
I20260809 18:46:44.858690 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 18:46:44 dist-test-slave-45dx krb5kdc[17894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301204, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 18:46:44 dist-test-slave-45dx krb5kdc[17894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301204, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:44.883040 18039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:44.875830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57792 (local address 127.12.202.254:42269)
0809 18:46:44.875899 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:44.875903 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:44.876062 (+ 159us) server_negotiation.cc:407] Connection header received
0809 18:46:44.876109 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:44.876110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:44.876120 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:44.876169 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:44.876863 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:44.877384 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:44.878114 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:44.878307 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:44.878370 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:44.880635 (+ 2265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:44.880636 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:44.880637 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:44.880643 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:44.882075 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:44.882355 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:44.882355 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:44.882356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:44.882406 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:44.882571 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:44.882571 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:44.882572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:44.882701 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:44.882774 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:44.882854 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 18:46:44.882930 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260809 18:46:44.883333 17970 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:57792
I20260809 18:46:44.883816 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 18080
I20260809 18:46:44.907469 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 18300
I20260809 18:46:44.921584 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 18521
I20260809 18:46:44.938267 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 17917
2026-08-09T18:46:44Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2132 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:46:44 dist-test-slave-45dx krb5kdc[18778](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:46:45 dist-test-slave-45dx krb5kdc[18778](info): set up 2 sockets
Aug 09 18:46:45 dist-test-slave-45dx krb5kdc[18778](info): commencing operation
krb5kdc: starting...
W20260809 18:46:46.200850 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:46:46 dist-test-slave-45dx krb5kdc[18778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301206, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:46:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:46:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:46:46.327082 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:43927
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:43927
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:46.410096 18809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:46.410312 18809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:46.410334 18809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:46.411381 18809 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:46:46.411412 18809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:46.411427 18809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:46.411439 18809 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:46:46.411450 18809 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:46:46.412950 18809 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:43927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:43927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:46.413141 18809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:46.413304 18809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:46.418177 18817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:46.418236 18809 server_base.cc:1034] running on GCE node
W20260809 18:46:46.418206 18816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:46.418233 18821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:46.418615 18809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:46.418919 18809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:46.420081 18809 hybrid_clock.cc:648] HybridClock initialized: now 1786301206420070 us; error 46 us; skew 500 ppm
Aug 09 18:46:46 dist-test-slave-45dx krb5kdc[18778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301206, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:46.422637 18809 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:46:46.423086 18809 webserver.cc:460] Webserver started at http://127.12.202.254:40937/ using document root <none> and password file <none>
I20260809 18:46:46.423303 18809 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:46.423370 18809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:46.423522 18809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:46.424623 18809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "fff6429057934d49a1c72705810adf4c"
format_stamp: "Formatted at 2026-08-09 18:46:46 on dist-test-slave-45dx"
server_key: "0c6da2ff80acda965bd4b03216abb5b9"
server_key_iv: "47784ddb736d83f0ecd41103f1514061"
server_key_version: "encryptionkey@0"
I20260809 18:46:46.424993 18809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "fff6429057934d49a1c72705810adf4c"
format_stamp: "Formatted at 2026-08-09 18:46:46 on dist-test-slave-45dx"
server_key: "0c6da2ff80acda965bd4b03216abb5b9"
server_key_iv: "47784ddb736d83f0ecd41103f1514061"
server_key_version: "encryptionkey@0"
I20260809 18:46:46.426308 18809 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 18:46:46.427094 18829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:46.427301 18809 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:46:46.427429 18809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "fff6429057934d49a1c72705810adf4c"
format_stamp: "Formatted at 2026-08-09 18:46:46 on dist-test-slave-45dx"
server_key: "0c6da2ff80acda965bd4b03216abb5b9"
server_key_iv: "47784ddb736d83f0ecd41103f1514061"
server_key_version: "encryptionkey@0"
I20260809 18:46:46.427507 18809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:46.446985 18809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:46.449205 18809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:46.449391 18809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:46.453799 18809 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:43927
I20260809 18:46:46.454083 18929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:43927 every 8 connection(s)
I20260809 18:46:46.454213 18809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:46:46.454988 18930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:46.457509 18930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c: Bootstrap starting.
I20260809 18:46:46.458173 18930 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:46.458489 18930 log.cc:824] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:46.459276 18930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c: No bootstrap required, opened a new log
I20260809 18:46:46.461041 18930 raft_consensus.cc:348] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff6429057934d49a1c72705810adf4c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43927 } }
I20260809 18:46:46.461189 18930 raft_consensus.cc:374] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:46.461211 18930 raft_consensus.cc:729] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fff6429057934d49a1c72705810adf4c, State: Initialized, Role: FOLLOWER
I20260809 18:46:46.461395 18930 consensus_queue.cc:260] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff6429057934d49a1c72705810adf4c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43927 } }
I20260809 18:46:46.461465 18930 raft_consensus.cc:388] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:46:46.461488 18930 raft_consensus.cc:482] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:46:46.461558 18930 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:46.462443 18930 raft_consensus.cc:504] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff6429057934d49a1c72705810adf4c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43927 } }
I20260809 18:46:46.462535 18930 leader_election.cc:302] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fff6429057934d49a1c72705810adf4c; no voters:
I20260809 18:46:46.462774 18930 leader_election.cc:288] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:46:46.462809 18940 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:46.462826 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 18809
I20260809 18:46:46.462936 18940 raft_consensus.cc:686] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c [term 1 LEADER]: Becoming Leader. State: Replica: fff6429057934d49a1c72705810adf4c, State: Running, Role: LEADER
I20260809 18:46:46.462957 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:46:46.463025 18940 consensus_queue.cc:237] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff6429057934d49a1c72705810adf4c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43927 } }
I20260809 18:46:46.463088 18930 sys_catalog.cc:564] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:46.463165 13099 external_mini_cluster.cc:1428] Setting key 264788d5aa86f0bc71fe9a183c819f93
I20260809 18:46:46.463518 18944 sys_catalog.cc:455] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader fff6429057934d49a1c72705810adf4c. Latest consensus state: current_term: 1 leader_uuid: "fff6429057934d49a1c72705810adf4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff6429057934d49a1c72705810adf4c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43927 } } }
I20260809 18:46:46.463711 18944 sys_catalog.cc:458] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:46.463649 18942 sys_catalog.cc:455] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fff6429057934d49a1c72705810adf4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff6429057934d49a1c72705810adf4c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43927 } } }
I20260809 18:46:46.463980 18942 sys_catalog.cc:458] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:46.464133 18965 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:46:46.464737 18965 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:46:46.466499 18965 catalog_manager.cc:1347] Generated new cluster ID: b455bafbee57466a93118113268852d2
I20260809 18:46:46.466554 18965 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:46:46 dist-test-slave-45dx krb5kdc[18778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301206, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:46.474846 18966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:46.463812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41516 (local address 127.12.202.254:43927)
0809 18:46:46.464006 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:46.464015 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:46.464047 (+ 32us) server_negotiation.cc:407] Connection header received
0809 18:46:46.464177 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:46.464184 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:46.464252 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:46.464453 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:46.465279 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:46.466365 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:46.467228 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:46.467636 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:46.467709 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:46.470723 (+ 3014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:46.470727 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:46.470727 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:46.470739 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:46.472757 (+ 2018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:46.473197 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:46.473200 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:46.473200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:46.473663 (+ 463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:46.473945 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:46.473946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:46.473946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:46.474236 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:46.474383 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:46.474521 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 18:46:46.474646 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":83,"threads_started":1}
I20260809 18:46:46.483748 18965 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:46:46.484294 18965 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:46:46.486497 18965 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fff6429057934d49a1c72705810adf4c: Generated new TSK 0
I20260809 18:46:46.486675 18965 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
I20260809 18:46:46.514588 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:43927
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:46.598781 18992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:46.598984 18992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:46.599007 18992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:46.600319 18992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:46.600368 18992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:46.600394 18992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:46:46.601927 18992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:43927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18992
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:46.602187 18992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:46.602429 18992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:46.607559 19004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:46.607550 19003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:46.607550 19007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:46.607913 18992 server_base.cc:1034] running on GCE node
I20260809 18:46:46.608151 18992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:46.608457 18992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:46.609633 18992 hybrid_clock.cc:648] HybridClock initialized: now 1786301206609615 us; error 31 us; skew 500 ppm
Aug 09 18:46:46 dist-test-slave-45dx krb5kdc[18778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301206, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:46.612176 18992 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:46:46.612707 18992 webserver.cc:460] Webserver started at http://127.12.202.193:44335/ using document root <none> and password file <none>
I20260809 18:46:46.612955 18992 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:46.613024 18992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:46.613173 18992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:46.614166 18992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "7a63a09bb496416fbca34254474a4216"
format_stamp: "Formatted at 2026-08-09 18:46:46 on dist-test-slave-45dx"
server_key: "f64b2d0f5cd4404914d8813aac84592b"
server_key_iv: "5d541f51f9e355f1f34e5efe12e5839a"
server_key_version: "encryptionkey@0"
I20260809 18:46:46.614555 18992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "7a63a09bb496416fbca34254474a4216"
format_stamp: "Formatted at 2026-08-09 18:46:46 on dist-test-slave-45dx"
server_key: "f64b2d0f5cd4404914d8813aac84592b"
server_key_iv: "5d541f51f9e355f1f34e5efe12e5839a"
server_key_version: "encryptionkey@0"
I20260809 18:46:46.615921 18992 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:46:46.616707 19020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:46.616883 18992 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:46.617019 18992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "7a63a09bb496416fbca34254474a4216"
format_stamp: "Formatted at 2026-08-09 18:46:46 on dist-test-slave-45dx"
server_key: "f64b2d0f5cd4404914d8813aac84592b"
server_key_iv: "5d541f51f9e355f1f34e5efe12e5839a"
server_key_version: "encryptionkey@0"
I20260809 18:46:46.617092 18992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:46.625960 18992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:46.627677 18992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:46.627839 18992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:46.628055 18992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:46.628381 18992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:46.628436 18992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:46.628491 18992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:46.628518 18992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:46.634622 18992 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:46709
I20260809 18:46:46.634672 19220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:46709 every 8 connection(s)
I20260809 18:46:46.634939 18992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
Aug 09 18:46:46 dist-test-slave-45dx krb5kdc[18778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301206, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:46.640756 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 18992
I20260809 18:46:46.640887 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:46:46.641075 13099 external_mini_cluster.cc:1428] Setting key dc61072576fe6a633ef2ab1086ae7301
I20260809 18:46:46.644685 18966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:46.635642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:57629 (local address 127.12.202.254:43927)
0809 18:46:46.635707 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:46.635709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:46.635866 (+ 157us) server_negotiation.cc:407] Connection header received
0809 18:46:46.636737 (+ 871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:46.636738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:46.636751 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:46.636806 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:46.637397 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:46.637898 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:46.638823 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:46.639023 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:46.639069 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:46.641258 (+ 2189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:46.641259 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:46.641260 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:46.641273 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:46.643117 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:46.643509 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:46.643510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:46.643510 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:46.643613 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:46.644013 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:46.644014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:46.644014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:46.644125 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:46.644179 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:46.644552 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 18:46:46.644620 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 18:46:46.645001 19226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:46.635585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43927 (local address 127.12.202.193:57629)
0809 18:46:46.635739 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:46.635778 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:46.636651 (+ 873us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:46.636881 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:46.636884 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:46.637121 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:46.637320 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:46.637323 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:46.637973 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:46.637974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:46.638749 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:46.638752 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:46.639088 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:46.639089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:46.639199 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:46.639717 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:46.639726 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:46.641165 (+ 1439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:46.643207 (+ 2042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:46.643214 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:46.643215 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:46.643437 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:46.643736 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:46.643737 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:46.643738 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:46.643928 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:46.644196 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:46.644203 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:46.644394 (+ 191us) client_negotiation.cc:769] Sending connection context
0809 18:46:46.644515 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 18:46:46.644703 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":87,"threads_started":1}
I20260809 18:46:46.645560 19223 heartbeater.cc:347] Connected to a master server at 127.12.202.254:43927
I20260809 18:46:46.645684 19223 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:46.645901 19223 heartbeater.cc:511] Master 127.12.202.254:43927 requested a full tablet report, sending...
I20260809 18:46:46.646440 18868 ts_manager.cc:194] Registered new tserver with Master: 7a63a09bb496416fbca34254474a4216 (127.12.202.193:46709)
I20260809 18:46:46.647059 18868 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:57629
WARNING: no policy specified for kudu/127.12.202.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
I20260809 18:46:46.669255 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:43927
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:46.750694 19234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:46.750957 19234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:46.751011 19234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:46.752152 19234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:46.752220 19234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:46.752265 19234 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:46:46.753767 19234 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:43927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19234
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:46.754043 19234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:46.754266 19234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:46.759284 19250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:46.759303 19247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:46.759295 19246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:46.759594 19234 server_base.cc:1034] running on GCE node
I20260809 18:46:46.759907 19234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:46.760258 19234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:46.761458 19234 hybrid_clock.cc:648] HybridClock initialized: now 1786301206761445 us; error 30 us; skew 500 ppm
Aug 09 18:46:46 dist-test-slave-45dx krb5kdc[18778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301206, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:46.764357 19234 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:46:46.764766 19234 webserver.cc:460] Webserver started at http://127.12.202.194:40659/ using document root <none> and password file <none>
I20260809 18:46:46.765060 19234 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:46.765127 19234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:46.765256 19234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:46.766227 19234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "4642280f8b094e3cbee601389e41164e"
format_stamp: "Formatted at 2026-08-09 18:46:46 on dist-test-slave-45dx"
server_key: "1fbc4731bd897579e32f3e44b1430262"
server_key_iv: "ef1cec8003f1557d572b1f94383a7d82"
server_key_version: "encryptionkey@0"
I20260809 18:46:46.766588 19234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "4642280f8b094e3cbee601389e41164e"
format_stamp: "Formatted at 2026-08-09 18:46:46 on dist-test-slave-45dx"
server_key: "1fbc4731bd897579e32f3e44b1430262"
server_key_iv: "ef1cec8003f1557d572b1f94383a7d82"
server_key_version: "encryptionkey@0"
I20260809 18:46:46.767872 19234 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 18:46:46.768651 19259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:46.768831 19234 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:46.768927 19234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "4642280f8b094e3cbee601389e41164e"
format_stamp: "Formatted at 2026-08-09 18:46:46 on dist-test-slave-45dx"
server_key: "1fbc4731bd897579e32f3e44b1430262"
server_key_iv: "ef1cec8003f1557d572b1f94383a7d82"
server_key_version: "encryptionkey@0"
I20260809 18:46:46.769006 19234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:46.806656 19234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:46.809222 19234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:46.809391 19234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:46.809659 19234 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:46.809994 19234 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:46.810056 19234 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:46.810101 19234 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:46.810132 19234 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:46.816022 19234 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:45155
I20260809 18:46:46.816120 19459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:45155 every 8 connection(s)
I20260809 18:46:46.816476 19234 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
Aug 09 18:46:46 dist-test-slave-45dx krb5kdc[18778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301206, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:46.824755 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 19234
I20260809 18:46:46.824887 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:46:46.825104 13099 external_mini_cluster.cc:1428] Setting key 35966d1b97a35f53c905146e9b692848
I20260809 18:46:46.826819 19462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:46.817260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43927 (local address 127.12.202.194:43381)
0809 18:46:46.817440 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:46.817483 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:46.818408 (+ 925us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:46.818640 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:46.818644 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:46.818896 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:46.819101 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:46.819105 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:46.820237 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:46.820237 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:46.821212 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:46.821215 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:46.821529 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:46.821542 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:46.821637 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:46.822279 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:46.822287 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:46.823624 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:46.825341 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:46.825349 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:46.825351 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:46.825672 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:46.825899 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:46.825900 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:46.825901 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:46.826031 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:46.826350 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:46.826355 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:46.826466 (+ 111us) client_negotiation.cc:769] Sending connection context
0809 18:46:46.826546 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 18:46:46.826662 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":108,"threads_started":1}
I20260809 18:46:46.826830 18966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:46.817298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:43381 (local address 127.12.202.254:43927)
0809 18:46:46.817346 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:46.817348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:46.817601 (+ 253us) server_negotiation.cc:407] Connection header received
0809 18:46:46.818510 (+ 909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:46.818511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:46.818522 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:46.818585 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:46.819277 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:46.820133 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:46.821288 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:46.821466 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:46.821519 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:46.823709 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:46.823710 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:46.823710 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:46.823717 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:46.825226 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:46.825756 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:46.825757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:46.825757 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:46.825825 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:46.826102 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:46.826103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:46.826103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:46.826253 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:46.826351 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:46.826593 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 18:46:46.826688 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 18:46:46.827335 19460 heartbeater.cc:347] Connected to a master server at 127.12.202.254:43927
I20260809 18:46:46.827442 19460 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:46.827633 19460 heartbeater.cc:511] Master 127.12.202.254:43927 requested a full tablet report, sending...
I20260809 18:46:46.828065 18868 ts_manager.cc:194] Registered new tserver with Master: 4642280f8b094e3cbee601389e41164e (127.12.202.194:45155)
I20260809 18:46:46.828538 18868 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:43381
WARNING: no policy specified for kudu/127.12.202.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
I20260809 18:46:46.851078 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:43927
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:46.931929 19466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:46.932122 19466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:46.932145 19466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:46.933350 19466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:46.933403 19466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:46.933429 19466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:46:46.934883 19466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:43927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:46.935133 19466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:46.935356 19466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:46.940431 19475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:46.940416 19476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:46.940621 19466 server_base.cc:1034] running on GCE node
W20260809 18:46:46.940416 19480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:46.940919 19466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:46.941205 19466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:46.942358 19466 hybrid_clock.cc:648] HybridClock initialized: now 1786301206942346 us; error 25 us; skew 500 ppm
Aug 09 18:46:46 dist-test-slave-45dx krb5kdc[18778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301206, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:46.944933 19466 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:46:46.945411 19466 webserver.cc:460] Webserver started at http://127.12.202.195:37063/ using document root <none> and password file <none>
I20260809 18:46:46.945654 19466 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:46.945698 19466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:46.945825 19466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:46.946872 19466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "589fbb90152b49479bdfbdb8250835f1"
format_stamp: "Formatted at 2026-08-09 18:46:46 on dist-test-slave-45dx"
server_key: "059cb7a7881dd4caddd76cdef39531ab"
server_key_iv: "cfd35f99c5f57926b87d763506a6ebbf"
server_key_version: "encryptionkey@0"
I20260809 18:46:46.947228 19466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "589fbb90152b49479bdfbdb8250835f1"
format_stamp: "Formatted at 2026-08-09 18:46:46 on dist-test-slave-45dx"
server_key: "059cb7a7881dd4caddd76cdef39531ab"
server_key_iv: "cfd35f99c5f57926b87d763506a6ebbf"
server_key_version: "encryptionkey@0"
I20260809 18:46:46.948772 19466 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:46:46.949580 19495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:46.949752 19466 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:46.949874 19466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "589fbb90152b49479bdfbdb8250835f1"
format_stamp: "Formatted at 2026-08-09 18:46:46 on dist-test-slave-45dx"
server_key: "059cb7a7881dd4caddd76cdef39531ab"
server_key_iv: "cfd35f99c5f57926b87d763506a6ebbf"
server_key_version: "encryptionkey@0"
I20260809 18:46:46.949954 19466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:46.966491 19466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:46.968283 19466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:46.968501 19466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:46.968731 19466 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:46.969038 19466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:46.969092 19466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:46.969132 19466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:46.969157 19466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:46.975461 19466 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:43729
I20260809 18:46:46.975509 19690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:43729 every 8 connection(s)
I20260809 18:46:46.975873 19466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:46:46.976008 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 19466
I20260809 18:46:46.976101 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:46:46.976338 13099 external_mini_cluster.cc:1428] Setting key 2fb69d8da237fee0f7fd46f4d9bf1b81
Aug 09 18:46:46 dist-test-slave-45dx krb5kdc[18778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301206, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:46.985293 18966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:46.976701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:56565 (local address 127.12.202.254:43927)
0809 18:46:46.976744 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:46.976746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:46.977031 (+ 285us) server_negotiation.cc:407] Connection header received
0809 18:46:46.978085 (+ 1054us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:46.978086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:46.978100 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:46.978152 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:46.978770 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:46.979234 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:46.980197 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:46.980460 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:46.980530 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:46.982567 (+ 2037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:46.982568 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:46.982569 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:46.982577 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:46.983772 (+ 1195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:46.984179 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:46.984181 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:46.984181 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:46.984247 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:46.984513 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:46.984514 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:46.984514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:46.984632 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:46.984710 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:46.985119 (+ 409us) server_negotiation.cc:299] Negotiation successful
0809 18:46:46.985204 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:46:46.985468 19695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:46.976706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43927 (local address 127.12.202.195:56565)
0809 18:46:46.976888 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:46.976957 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:46.977970 (+ 1013us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:46.978218 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:46.978222 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:46.978499 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:46.978683 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:46.978687 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:46.979331 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:46.979338 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:46.980101 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:46.980103 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:46.980538 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:46.980539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:46.980659 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:46.981057 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:46.981064 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:46.982471 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:46.983876 (+ 1405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:46.983884 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:46.983886 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:46.984103 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:46.984326 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:46.984327 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:46.984327 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:46.984442 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:46.984784 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:46.984791 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:46.984965 (+ 174us) client_negotiation.cc:769] Sending connection context
0809 18:46:46.985081 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 18:46:46.985230 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":87,"threads_started":1}
I20260809 18:46:46.985947 19691 heartbeater.cc:347] Connected to a master server at 127.12.202.254:43927
I20260809 18:46:46.986047 19691 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:46.986241 19691 heartbeater.cc:511] Master 127.12.202.254:43927 requested a full tablet report, sending...
I20260809 18:46:46.986667 18868 ts_manager.cc:194] Registered new tserver with Master: 589fbb90152b49479bdfbdb8250835f1 (127.12.202.195:43729)
I20260809 18:46:46.987124 18868 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:56565
I20260809 18:46:46.988137 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 18:46:46 dist-test-slave-45dx krb5kdc[18778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301206, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 18:46:47 dist-test-slave-45dx krb5kdc[18778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301206, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.193@KRBTEST.COM
I20260809 18:46:47.011852 19702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:47.004609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50214 (local address 127.12.202.193:46709)
0809 18:46:47.004785 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:47.004790 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:47.004801 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:46:47.004832 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:47.004834 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:47.004850 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:47.004932 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:47.005476 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:47.006164 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:47.006863 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:47.007155 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:47.007205 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:47.009500 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:47.009508 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:47.009508 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:47.009514 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:47.010890 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:47.011197 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:47.011200 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:47.011201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:47.011273 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:47.011437 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:47.011438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:47.011438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:47.011559 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:47.011666 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:47.011718 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 18:46:47.011777 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":96,"threads_started":1}
Aug 09 18:46:47 dist-test-slave-45dx krb5kdc[18778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301206, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:47.019574 18966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:47.013222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41526 (local address 127.12.202.254:43927)
0809 18:46:47.013293 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:47.013294 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:47.013309 (+ 15us) server_negotiation.cc:407] Connection header received
0809 18:46:47.013362 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:47.013363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:47.013371 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:47.013414 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:47.013809 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:47.014260 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:47.014876 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:47.015117 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:47.015168 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:47.017285 (+ 2117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:47.017286 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:47.017286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:47.017292 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:47.018490 (+ 1198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:47.018790 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:47.018790 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:47.018791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:47.018849 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:47.019007 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:47.019008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:47.019008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:47.019180 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:47.019252 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:47.019377 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 18:46:47.019442 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260809 18:46:47.019776 18868 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41526
I20260809 18:46:47.020097 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 18992
I20260809 18:46:47.032450 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 19234
I20260809 18:46:47.048291 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 19466
I20260809 18:46:47.060560 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 18809
2026-08-09T18:46:47Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2121 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:46:47 dist-test-slave-45dx krb5kdc[19710](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:46:47 dist-test-slave-45dx krb5kdc[19710](info): set up 2 sockets
Aug 09 18:46:47 dist-test-slave-45dx krb5kdc[19710](info): commencing operation
krb5kdc: starting...
W20260809 18:46:48.303910 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.219s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:46:48 dist-test-slave-45dx krb5kdc[19710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301208, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:46:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:46:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:46:48.443056 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:32901
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:34099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:32901
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:48.526785 19732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:48.527029 19732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:48.527069 19732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:48.528260 19732 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:46:48.528347 19732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:48.528375 19732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:48.528407 19732 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:46:48.528434 19732 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:46:48.530001 19732 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:34099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:32901
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:32901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19732
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:48.530297 19732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:48.530567 19732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:48.535622 19739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:48.535653 19742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:48.535646 19740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:48.535800 19732 server_base.cc:1034] running on GCE node
I20260809 18:46:48.536144 19732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:48.536473 19732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:48.537647 19732 hybrid_clock.cc:648] HybridClock initialized: now 1786301208537630 us; error 29 us; skew 500 ppm
Aug 09 18:46:48 dist-test-slave-45dx krb5kdc[19710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301208, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:48.544514 19732 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:46:48.544942 19732 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:48.545018 19732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:48.545166 19732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:48.546236 19732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "f4ed23bec8044821bbfd918cb3ae0e9e"
format_stamp: "Formatted at 2026-08-09 18:46:48 on dist-test-slave-45dx"
server_key: "f9be5a3fd01df35b0e5e7a5d894a8c8f"
server_key_iv: "724ee60026089aac5d5ce8af3ed7b53c"
server_key_version: "encryptionkey@0"
I20260809 18:46:48.546620 19732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "f4ed23bec8044821bbfd918cb3ae0e9e"
format_stamp: "Formatted at 2026-08-09 18:46:48 on dist-test-slave-45dx"
server_key: "f9be5a3fd01df35b0e5e7a5d894a8c8f"
server_key_iv: "724ee60026089aac5d5ce8af3ed7b53c"
server_key_version: "encryptionkey@0"
I20260809 18:46:48.547948 19732 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:46:48.548820 19751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:48.549010 19732 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:46:48.549113 19732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "f4ed23bec8044821bbfd918cb3ae0e9e"
format_stamp: "Formatted at 2026-08-09 18:46:48 on dist-test-slave-45dx"
server_key: "f9be5a3fd01df35b0e5e7a5d894a8c8f"
server_key_iv: "724ee60026089aac5d5ce8af3ed7b53c"
server_key_version: "encryptionkey@0"
I20260809 18:46:48.549193 19732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:48.560945 19732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:48.562812 19732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:48.562976 19732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:48.567286 19732 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:32901
I20260809 18:46:48.567323 19848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:32901 every 8 connection(s)
I20260809 18:46:48.567660 19732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:46:48.568043 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 19732
I20260809 18:46:48.568202 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:46:48.568475 13099 external_mini_cluster.cc:1428] Setting key d3947015fa37d97124745077a360a6a5
I20260809 18:46:48.568985 19850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:48.572229 19850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e: Bootstrap starting.
I20260809 18:46:48.572942 19850 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:48.573239 19850 log.cc:824] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:48.574131 19850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e: No bootstrap required, opened a new log
Aug 09 18:46:48 dist-test-slave-45dx krb5kdc[19710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301208, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:48.575985 19850 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4ed23bec8044821bbfd918cb3ae0e9e" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32901 } }
I20260809 18:46:48.576169 19850 raft_consensus.cc:374] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:48.576211 19850 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ed23bec8044821bbfd918cb3ae0e9e, State: Initialized, Role: FOLLOWER
I20260809 18:46:48.576385 19850 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4ed23bec8044821bbfd918cb3ae0e9e" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32901 } }
I20260809 18:46:48.576500 19850 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:46:48.576551 19850 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:46:48.576601 19850 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:48.577150 19850 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4ed23bec8044821bbfd918cb3ae0e9e" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32901 } }
I20260809 18:46:48.577271 19850 leader_election.cc:302] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4ed23bec8044821bbfd918cb3ae0e9e; no voters:
I20260809 18:46:48.577486 19850 leader_election.cc:288] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:46:48.577518 19858 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:48.577628 19858 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e [term 1 LEADER]: Becoming Leader. State: Replica: f4ed23bec8044821bbfd918cb3ae0e9e, State: Running, Role: LEADER
I20260809 18:46:48.577710 19858 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4ed23bec8044821bbfd918cb3ae0e9e" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32901 } }
I20260809 18:46:48.577760 19850 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:48.578048 19858 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4ed23bec8044821bbfd918cb3ae0e9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4ed23bec8044821bbfd918cb3ae0e9e" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32901 } } }
I20260809 18:46:48.578125 19858 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:48.578249 19858 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4ed23bec8044821bbfd918cb3ae0e9e. Latest consensus state: current_term: 1 leader_uuid: "f4ed23bec8044821bbfd918cb3ae0e9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4ed23bec8044821bbfd918cb3ae0e9e" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32901 } } }
I20260809 18:46:48.578322 19858 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e [sys.catalog]: This master's current role is: LEADER
W20260809 18:46:48.579576 19886 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:46:48.579638 19886 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:46:48.579684 19866 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:46:48.579873 19866 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:46:48.580295 19855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:48.569061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49316 (local address 127.12.202.254:32901)
0809 18:46:48.569270 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:48.569279 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:48.569311 (+ 32us) server_negotiation.cc:407] Connection header received
0809 18:46:48.569828 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:48.569837 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:48.569898 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:48.570044 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:48.570690 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:48.571999 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:48.572826 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:48.573444 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:48.573547 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:48.575973 (+ 2426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:48.575977 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:48.575977 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:48.575988 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:48.578435 (+ 2447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:48.578933 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:48.578937 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:48.578937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:48.579062 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:48.579316 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:48.579318 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:48.579318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:48.579624 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:48.579855 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:48.579982 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 18:46:48.580121 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":104,"threads_started":1}
I20260809 18:46:48.581383 19866 catalog_manager.cc:1347] Generated new cluster ID: 96795799b9a34af79084449cf894eef4
I20260809 18:46:48.581432 19866 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:46:48.600050 19866 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:46:48.600742 19866 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:46:48.610764 19866 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e: Generated new TSK 0
I20260809 18:46:48.611011 19866 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
I20260809 18:46:48.642990 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:32901
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:34099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:48.744561 19895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:48.744750 19895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:48.744773 19895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:48.745891 19895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:48.745934 19895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:48.745995 19895 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:46:48.747512 19895 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:34099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:32901
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:48.747759 19895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:48.747992 19895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:48.753078 19904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:48.753070 19895 server_base.cc:1034] running on GCE node
W20260809 18:46:48.753049 19906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:48.753036 19903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:48.753545 19895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:48.753806 19895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:48.754969 19895 hybrid_clock.cc:648] HybridClock initialized: now 1786301208754964 us; error 37 us; skew 500 ppm
Aug 09 18:46:48 dist-test-slave-45dx krb5kdc[19710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301208, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:48.757453 19895 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:46:48.757891 19895 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:48.757972 19895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:48.758123 19895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:48.759155 19895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "fbd05a5721404070b829057e9b14ffc0"
format_stamp: "Formatted at 2026-08-09 18:46:48 on dist-test-slave-45dx"
server_key: "3e14f7379535424a9e8aa8b4561952cf"
server_key_iv: "4281bfa3ee61bfb38f5b5ba7f06ec03c"
server_key_version: "encryptionkey@0"
I20260809 18:46:48.759516 19895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "fbd05a5721404070b829057e9b14ffc0"
format_stamp: "Formatted at 2026-08-09 18:46:48 on dist-test-slave-45dx"
server_key: "3e14f7379535424a9e8aa8b4561952cf"
server_key_iv: "4281bfa3ee61bfb38f5b5ba7f06ec03c"
server_key_version: "encryptionkey@0"
I20260809 18:46:48.760921 19895 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:46:48.761595 19913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:48.761766 19895 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:48.761916 19895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "fbd05a5721404070b829057e9b14ffc0"
format_stamp: "Formatted at 2026-08-09 18:46:48 on dist-test-slave-45dx"
server_key: "3e14f7379535424a9e8aa8b4561952cf"
server_key_iv: "4281bfa3ee61bfb38f5b5ba7f06ec03c"
server_key_version: "encryptionkey@0"
I20260809 18:46:48.762001 19895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:48.796782 19895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:48.799331 19895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:48.799533 19895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:48.799835 19895 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:48.800169 19895 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:48.800226 19895 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:48.800263 19895 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:48.800335 19895 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:48.806471 19895 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:42693
I20260809 18:46:48.806516 20114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:42693 every 8 connection(s)
I20260809 18:46:48.806782 19895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:46:48.809230 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 19895
I20260809 18:46:48.809346 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:46:48.809544 13099 external_mini_cluster.cc:1428] Setting key 143edd1dbf1f6860b4a0829e7c3378e5
Aug 09 18:46:48 dist-test-slave-45dx krb5kdc[19710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301208, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:48.816849 19855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:48.807586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:55797 (local address 127.12.202.254:32901)
0809 18:46:48.807759 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:48.807761 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:48.807924 (+ 163us) server_negotiation.cc:407] Connection header received
0809 18:46:48.808500 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:48.808502 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:48.808516 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:48.808582 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:48.809749 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:48.810284 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:48.811316 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:48.811580 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:48.811660 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:48.813915 (+ 2255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:48.813917 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:48.813917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:48.813925 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:48.815445 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:48.815845 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:48.815846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:48.815847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:48.815907 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:48.816153 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:48.816154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:48.816155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:48.816266 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:48.816382 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:48.816659 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 18:46:48.816750 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260809 18:46:48.817034 20120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:48.807533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:32901 (local address 127.12.202.193:55797)
0809 18:46:48.807768 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:48.807825 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:48.808380 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:48.808663 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:48.808667 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:48.808971 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:48.809625 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:48.809633 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:48.810393 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:48.810395 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:48.811209 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:48.811211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:48.811669 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:48.811670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:48.811803 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:48.812387 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:48.812396 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:48.813813 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:48.815530 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:48.815537 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:48.815539 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:48.815759 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:48.815980 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:48.815981 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:48.815982 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:48.816085 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:48.816372 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:48.816380 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:48.816525 (+ 145us) client_negotiation.cc:769] Sending connection context
0809 18:46:48.816636 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 18:46:48.816791 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":98,"threads_started":1}
I20260809 18:46:48.817596 20116 heartbeater.cc:347] Connected to a master server at 127.12.202.254:32901
I20260809 18:46:48.817706 20116 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:48.817869 20116 heartbeater.cc:511] Master 127.12.202.254:32901 requested a full tablet report, sending...
I20260809 18:46:48.818387 19785 ts_manager.cc:194] Registered new tserver with Master: fbd05a5721404070b829057e9b14ffc0 (127.12.202.193:42693)
WARNING: no policy specified for kudu/127.12.202.194@KRBTEST.COM; defaulting to no policy
I20260809 18:46:48.819063 19785 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:55797
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
I20260809 18:46:48.836542 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:32901
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:34099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:48.920835 20124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:48.921123 20124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:48.921167 20124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:48.922407 20124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:48.922487 20124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:48.922531 20124 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:46:48.924146 20124 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:34099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:32901
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20124
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:48.924464 20124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:48.924713 20124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:48.930015 20135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:48.930042 20124 server_base.cc:1034] running on GCE node
W20260809 18:46:48.930023 20139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:48.930032 20132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:48.930424 20124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:48.930680 20124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:48.931874 20124 hybrid_clock.cc:648] HybridClock initialized: now 1786301208931876 us; error 65 us; skew 500 ppm
Aug 09 18:46:48 dist-test-slave-45dx krb5kdc[19710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301208, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:48.934739 20124 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:46:48.935159 20124 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:48.935236 20124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:48.935397 20124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:48.936539 20124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "39d5293c45e14d9ebeaa20463725012e"
format_stamp: "Formatted at 2026-08-09 18:46:48 on dist-test-slave-45dx"
server_key: "eb9b0a19e334ee9885edefe6161db6ca"
server_key_iv: "25d0a390903fdec69a8d1d8d0bad51d2"
server_key_version: "encryptionkey@0"
I20260809 18:46:48.936926 20124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "39d5293c45e14d9ebeaa20463725012e"
format_stamp: "Formatted at 2026-08-09 18:46:48 on dist-test-slave-45dx"
server_key: "eb9b0a19e334ee9885edefe6161db6ca"
server_key_iv: "25d0a390903fdec69a8d1d8d0bad51d2"
server_key_version: "encryptionkey@0"
I20260809 18:46:48.938259 20124 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:48.939024 20150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:48.939208 20124 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:48.939316 20124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "39d5293c45e14d9ebeaa20463725012e"
format_stamp: "Formatted at 2026-08-09 18:46:48 on dist-test-slave-45dx"
server_key: "eb9b0a19e334ee9885edefe6161db6ca"
server_key_iv: "25d0a390903fdec69a8d1d8d0bad51d2"
server_key_version: "encryptionkey@0"
I20260809 18:46:48.939404 20124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:48.957862 20124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:48.960376 20124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:48.960556 20124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:48.960829 20124 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:48.961185 20124 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:48.961252 20124 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:48.961288 20124 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:48.961321 20124 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:48.967859 20124 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:40521
I20260809 18:46:48.967905 20341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:40521 every 8 connection(s)
I20260809 18:46:48.968189 20124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:46:48.971647 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 20124
I20260809 18:46:48.971889 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:46:48.972101 13099 external_mini_cluster.cc:1428] Setting key c1b12033c91ec4b2afc7c5cc3c379ce0
Aug 09 18:46:48 dist-test-slave-45dx krb5kdc[19710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301208, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:48.978441 19855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:48.969039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:60547 (local address 127.12.202.254:32901)
0809 18:46:48.969127 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:48.969130 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:48.969329 (+ 199us) server_negotiation.cc:407] Connection header received
0809 18:46:48.969828 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:48.969829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:48.969841 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:48.969914 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:48.970873 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:48.971375 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:48.972686 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:48.972996 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:48.973075 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:48.975365 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:48.975367 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:48.975367 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:48.975378 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:48.976901 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:48.977389 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:48.977391 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:48.977391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:48.977459 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:48.977738 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:48.977739 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:48.977739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:48.977868 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:48.977950 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:48.978262 (+ 312us) server_negotiation.cc:299] Negotiation successful
0809 18:46:48.978347 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 18:46:48.978644 20349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:48.968991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:32901 (local address 127.12.202.194:60547)
0809 18:46:48.969169 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:48.969215 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:48.969738 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:48.969971 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:48.969974 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:48.970243 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:48.970764 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:48.970770 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:48.971485 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:48.971486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:48.972580 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:48.972584 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:48.973091 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:48.973092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:48.973227 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:48.973820 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:48.973828 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:48.975258 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:48.977006 (+ 1748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:48.977020 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:48.977022 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:48.977287 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:48.977530 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:48.977531 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:48.977531 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:48.977650 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:48.977941 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:48.977949 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:48.978119 (+ 170us) client_negotiation.cc:769] Sending connection context
0809 18:46:48.978224 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 18:46:48.978396 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":99,"threads_started":1}
I20260809 18:46:48.979146 20343 heartbeater.cc:347] Connected to a master server at 127.12.202.254:32901
I20260809 18:46:48.979243 20343 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:48.979429 20343 heartbeater.cc:511] Master 127.12.202.254:32901 requested a full tablet report, sending...
I20260809 18:46:48.979867 19785 ts_manager.cc:194] Registered new tserver with Master: 39d5293c45e14d9ebeaa20463725012e (127.12.202.194:40521)
I20260809 18:46:48.980427 19785 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:60547
WARNING: no policy specified for kudu/127.12.202.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
I20260809 18:46:48.999740 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:32901
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:34099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:49.084821 20353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:49.085026 20353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:49.085052 20353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:49.086200 20353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:49.086242 20353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:49.086269 20353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:46:49.087847 20353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:34099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:32901
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:49.088093 20353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:49.088406 20353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:49.093607 20365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:49.093597 20361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:49.093817 20353 server_base.cc:1034] running on GCE node
W20260809 18:46:49.093593 20362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:49.094075 20353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:49.094287 20353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:49.095484 20353 hybrid_clock.cc:648] HybridClock initialized: now 1786301209095467 us; error 33 us; skew 500 ppm
Aug 09 18:46:49 dist-test-slave-45dx krb5kdc[19710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301209, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:49.098137 20353 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:46:49.098557 20353 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:49.098634 20353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:49.098791 20353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:49.099872 20353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "039b31619ba749fe839708c9a805da13"
format_stamp: "Formatted at 2026-08-09 18:46:49 on dist-test-slave-45dx"
server_key: "eca56606444362cdc839147e3c09f5e0"
server_key_iv: "654c3010830f6ebff1edebd30597f981"
server_key_version: "encryptionkey@0"
I20260809 18:46:49.100252 20353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "039b31619ba749fe839708c9a805da13"
format_stamp: "Formatted at 2026-08-09 18:46:49 on dist-test-slave-45dx"
server_key: "eca56606444362cdc839147e3c09f5e0"
server_key_iv: "654c3010830f6ebff1edebd30597f981"
server_key_version: "encryptionkey@0"
I20260809 18:46:49.101604 20353 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:49.102358 20372 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:49.102533 20353 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:49.102644 20353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "039b31619ba749fe839708c9a805da13"
format_stamp: "Formatted at 2026-08-09 18:46:49 on dist-test-slave-45dx"
server_key: "eca56606444362cdc839147e3c09f5e0"
server_key_iv: "654c3010830f6ebff1edebd30597f981"
server_key_version: "encryptionkey@0"
I20260809 18:46:49.102723 20353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:49.116969 20353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:49.118983 20353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:49.119153 20353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:49.119405 20353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:49.119722 20353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:49.119779 20353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:49.119822 20353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:49.119848 20353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:49.126145 20353 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:41301
I20260809 18:46:49.126257 20563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:41301 every 8 connection(s)
I20260809 18:46:49.126493 20353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:46:49 dist-test-slave-45dx krb5kdc[19710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301209, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:49.135473 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 20353
I20260809 18:46:49.135574 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:46:49.135795 13099 external_mini_cluster.cc:1428] Setting key c68f4c2c6e6948e7e2133e541623dfca
I20260809 18:46:49.136704 19855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.127305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:55605 (local address 127.12.202.254:32901)
0809 18:46:49.127350 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:49.127352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:49.127563 (+ 211us) server_negotiation.cc:407] Connection header received
0809 18:46:49.128126 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:49.128127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:49.128142 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:49.128245 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:49.129508 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.130025 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.131024 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.131228 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.131296 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:49.133545 (+ 2249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:49.133546 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:49.133546 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:49.133553 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:49.135126 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:49.135502 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:49.135503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:49.135504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:49.135577 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:49.135909 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:49.135910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:49.135910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:49.136076 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:49.136160 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:49.136519 (+ 359us) server_negotiation.cc:299] Negotiation successful
0809 18:46:49.136616 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 18:46:49.136914 20572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.127248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:32901 (local address 127.12.202.195:55605)
0809 18:46:49.127428 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:49.127470 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:49.127992 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:49.128360 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:49.128365 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:49.128795 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:49.129420 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:49.129426 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.130110 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.130111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:49.130920 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:49.130922 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.131310 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.131311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:49.131420 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:49.131895 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:49.131903 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:49.133457 (+ 1554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:49.135200 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:49.135205 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:49.135206 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:49.135422 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:49.135669 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:49.135670 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:49.135671 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:49.135828 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:49.136162 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:49.136170 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:49.136361 (+ 191us) client_negotiation.cc:769] Sending connection context
0809 18:46:49.136479 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 18:46:49.136643 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":115,"threads_started":1}
I20260809 18:46:49.137418 20568 heartbeater.cc:347] Connected to a master server at 127.12.202.254:32901
I20260809 18:46:49.137521 20568 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:49.137648 20568 heartbeater.cc:511] Master 127.12.202.254:32901 requested a full tablet report, sending...
I20260809 18:46:49.138002 19785 ts_manager.cc:194] Registered new tserver with Master: 039b31619ba749fe839708c9a805da13 (127.12.202.195:41301)
I20260809 18:46:49.138393 19785 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:55605
I20260809 18:46:49.147712 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:46:49.155423 19855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.149115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49324 (local address 127.12.202.254:32901)
0809 18:46:49.149188 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:49.149191 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:49.149275 (+ 84us) server_negotiation.cc:407] Connection header received
0809 18:46:49.149353 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:49.149354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:49.149366 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:49.149438 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:49.150024 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.150510 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.151286 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.151509 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.151585 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:49.152890 (+ 1305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:49.152891 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:49.152892 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:49.152899 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:49.154153 (+ 1254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:49.154577 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:49.154578 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:49.154579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:49.154643 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:49.154858 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:49.154859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:49.154859 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:49.155014 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:49.155125 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:49.155242 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 18:46:49.155322 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 18:46:49.157090 19785 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49324:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:46:49.158620 19785 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:46:49.165241 20587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.161105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:40521 (local address 127.0.0.1:52538)
0809 18:46:49.161373 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:49.161382 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:49.161425 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:49.161819 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:49.161820 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:49.161822 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:49.161856 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:49.161857 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.162774 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.162775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:49.164169 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:49.164171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.164910 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.164911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:49.164991 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:49.165006 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 18:46:49.165075 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 18:46:49.165134 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":24,"thread_start_us":69,"threads_started":1}
I20260809 18:46:49.165500 20591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.161024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47788 (local address 127.12.202.195:41301)
0809 18:46:49.161330 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:49.161336 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:49.161349 (+ 13us) server_negotiation.cc:407] Connection header received
0809 18:46:49.161391 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:49.161393 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:49.161409 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:49.161488 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:49.161772 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.162887 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.164203 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.164970 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.165050 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:49.165106 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:49.165260 (+ 154us) server_negotiation.cc:299] Negotiation successful
0809 18:46:49.165417 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":102,"threads_started":1}
I20260809 18:46:49.165517 20593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.160947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:42693 (local address 127.0.0.1:56842)
0809 18:46:49.161325 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:49.161336 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:49.161389 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:49.161676 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:49.161677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:49.161680 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:49.161757 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:49.161759 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.163098 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.163099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:49.164141 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:49.164144 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.165286 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.165286 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:49.165349 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:49.165353 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:46:49.165405 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 18:46:49.165444 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"mutex_wait_us":18,"thread_start_us":98,"threads_started":1}
I20260809 18:46:49.165624 20595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.161357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52538 (local address 127.12.202.194:40521)
0809 18:46:49.161560 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:49.161563 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:49.161571 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:46:49.161603 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:49.161604 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:49.161616 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:49.161710 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:49.161936 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.162659 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.164260 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.164817 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.164912 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:49.164972 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:49.165484 (+ 512us) server_negotiation.cc:299] Negotiation successful
0809 18:46:49.165534 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":94,"threads_started":1}
I20260809 18:46:49.165541 20590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.160907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:41301 (local address 127.0.0.1:47788)
0809 18:46:49.161118 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:49.161163 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:49.161228 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:49.161593 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:49.161596 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:49.161598 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:49.161667 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:49.161669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.162992 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.162993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:49.164114 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:49.164117 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.165057 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.165058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:49.165112 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:49.165115 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:46:49.165195 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 18:46:49.165230 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":7,"thread_start_us":65,"threads_started":1}
I20260809 18:46:49.165812 20594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.161089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56842 (local address 127.12.202.193:42693)
0809 18:46:49.161513 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:49.161518 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:49.161526 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:46:49.161565 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:49.161567 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:49.161582 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:49.161664 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:49.161902 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.162992 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.164256 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.164983 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.165053 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:49.165106 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:49.165666 (+ 560us) server_negotiation.cc:299] Negotiation successful
0809 18:46:49.165722 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":87,"threads_started":1}
I20260809 18:46:49.166445 20010 tablet_service.cc:1467] Processing CreateTablet for tablet 3b08f8f02cb94b7b8ec81ceef62beec9 (DEFAULT_TABLE table=test-table [id=2e0591d2e5214346b2050577cee646ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:49.166450 20234 tablet_service.cc:1467] Processing CreateTablet for tablet 3b08f8f02cb94b7b8ec81ceef62beec9 (DEFAULT_TABLE table=test-table [id=2e0591d2e5214346b2050577cee646ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:49.166530 20462 tablet_service.cc:1467] Processing CreateTablet for tablet 3b08f8f02cb94b7b8ec81ceef62beec9 (DEFAULT_TABLE table=test-table [id=2e0591d2e5214346b2050577cee646ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:49.166817 20010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b08f8f02cb94b7b8ec81ceef62beec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:49.166819 20462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b08f8f02cb94b7b8ec81ceef62beec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:49.166819 20234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b08f8f02cb94b7b8ec81ceef62beec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:49.169687 20596 tablet_bootstrap.cc:492] T 3b08f8f02cb94b7b8ec81ceef62beec9 P fbd05a5721404070b829057e9b14ffc0: Bootstrap starting.
I20260809 18:46:49.170166 20599 tablet_bootstrap.cc:492] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13: Bootstrap starting.
I20260809 18:46:49.170496 20596 tablet_bootstrap.cc:654] T 3b08f8f02cb94b7b8ec81ceef62beec9 P fbd05a5721404070b829057e9b14ffc0: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:49.170840 20599 tablet_bootstrap.cc:654] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:49.171164 20596 log.cc:824] T 3b08f8f02cb94b7b8ec81ceef62beec9 P fbd05a5721404070b829057e9b14ffc0: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:49.171497 20599 log.cc:824] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:49.171860 20597 tablet_bootstrap.cc:492] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e: Bootstrap starting.
I20260809 18:46:49.172103 20596 tablet_bootstrap.cc:492] T 3b08f8f02cb94b7b8ec81ceef62beec9 P fbd05a5721404070b829057e9b14ffc0: No bootstrap required, opened a new log
I20260809 18:46:49.172267 20596 ts_tablet_manager.cc:1397] T 3b08f8f02cb94b7b8ec81ceef62beec9 P fbd05a5721404070b829057e9b14ffc0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:46:49.172542 20597 tablet_bootstrap.cc:654] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:49.173130 20597 log.cc:824] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:49.173708 20599 tablet_bootstrap.cc:492] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13: No bootstrap required, opened a new log
I20260809 18:46:49.173789 20599 ts_tablet_manager.cc:1397] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 18:46:49.173942 20597 tablet_bootstrap.cc:492] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e: No bootstrap required, opened a new log
I20260809 18:46:49.174026 20597 ts_tablet_manager.cc:1397] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:46:49.174566 20596 raft_consensus.cc:348] T 3b08f8f02cb94b7b8ec81ceef62beec9 P fbd05a5721404070b829057e9b14ffc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039b31619ba749fe839708c9a805da13" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 41301 } } peers { permanent_uuid: "39d5293c45e14d9ebeaa20463725012e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40521 } } peers { permanent_uuid: "fbd05a5721404070b829057e9b14ffc0" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 42693 } }
I20260809 18:46:49.174746 20596 raft_consensus.cc:374] T 3b08f8f02cb94b7b8ec81ceef62beec9 P fbd05a5721404070b829057e9b14ffc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:49.174808 20596 raft_consensus.cc:729] T 3b08f8f02cb94b7b8ec81ceef62beec9 P fbd05a5721404070b829057e9b14ffc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbd05a5721404070b829057e9b14ffc0, State: Initialized, Role: FOLLOWER
I20260809 18:46:49.174973 20596 consensus_queue.cc:260] T 3b08f8f02cb94b7b8ec81ceef62beec9 P fbd05a5721404070b829057e9b14ffc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039b31619ba749fe839708c9a805da13" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 41301 } } peers { permanent_uuid: "39d5293c45e14d9ebeaa20463725012e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40521 } } peers { permanent_uuid: "fbd05a5721404070b829057e9b14ffc0" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 42693 } }
I20260809 18:46:49.175275 20596 ts_tablet_manager.cc:1428] T 3b08f8f02cb94b7b8ec81ceef62beec9 P fbd05a5721404070b829057e9b14ffc0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:46:49.175417 20116 heartbeater.cc:503] Master 127.12.202.254:32901 was elected leader, sending a full tablet report...
I20260809 18:46:49.175808 20597 raft_consensus.cc:348] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039b31619ba749fe839708c9a805da13" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 41301 } } peers { permanent_uuid: "39d5293c45e14d9ebeaa20463725012e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40521 } } peers { permanent_uuid: "fbd05a5721404070b829057e9b14ffc0" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 42693 } }
I20260809 18:46:49.175844 20599 raft_consensus.cc:348] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039b31619ba749fe839708c9a805da13" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 41301 } } peers { permanent_uuid: "39d5293c45e14d9ebeaa20463725012e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40521 } } peers { permanent_uuid: "fbd05a5721404070b829057e9b14ffc0" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 42693 } }
I20260809 18:46:49.175954 20597 raft_consensus.cc:374] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:49.175995 20597 raft_consensus.cc:729] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d5293c45e14d9ebeaa20463725012e, State: Initialized, Role: FOLLOWER
I20260809 18:46:49.175997 20599 raft_consensus.cc:374] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:49.176043 20599 raft_consensus.cc:729] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039b31619ba749fe839708c9a805da13, State: Initialized, Role: FOLLOWER
I20260809 18:46:49.176155 20599 consensus_queue.cc:260] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039b31619ba749fe839708c9a805da13" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 41301 } } peers { permanent_uuid: "39d5293c45e14d9ebeaa20463725012e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40521 } } peers { permanent_uuid: "fbd05a5721404070b829057e9b14ffc0" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 42693 } }
I20260809 18:46:49.176159 20597 consensus_queue.cc:260] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039b31619ba749fe839708c9a805da13" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 41301 } } peers { permanent_uuid: "39d5293c45e14d9ebeaa20463725012e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40521 } } peers { permanent_uuid: "fbd05a5721404070b829057e9b14ffc0" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 42693 } }
I20260809 18:46:49.176486 20599 ts_tablet_manager.cc:1428] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260809 18:46:49.176509 20597 ts_tablet_manager.cc:1428] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 18:46:49.176604 20568 heartbeater.cc:503] Master 127.12.202.254:32901 was elected leader, sending a full tablet report...
I20260809 18:46:49.176642 20343 heartbeater.cc:503] Master 127.12.202.254:32901 was elected leader, sending a full tablet report...
W20260809 18:46:49.218839 20347 tablet.cc:2369] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:46:49.307564 20118 tablet.cc:2369] T 3b08f8f02cb94b7b8ec81ceef62beec9 P fbd05a5721404070b829057e9b14ffc0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:46:49.377187 20570 tablet.cc:2369] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:46:49.414230 20613 raft_consensus.cc:482] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:46:49.414399 20613 raft_consensus.cc:504] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039b31619ba749fe839708c9a805da13" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 41301 } } peers { permanent_uuid: "39d5293c45e14d9ebeaa20463725012e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40521 } } peers { permanent_uuid: "fbd05a5721404070b829057e9b14ffc0" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 42693 } }
I20260809 18:46:49.414855 20613 leader_election.cc:288] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39d5293c45e14d9ebeaa20463725012e (127.12.202.194:40521), fbd05a5721404070b829057e9b14ffc0 (127.12.202.193:42693)
I20260809 18:46:49.418988 20572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.415085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:42693 (local address 127.12.202.195:41897)
0809 18:46:49.415155 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:49.415168 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:49.415216 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:49.415417 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:49.415418 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:49.415420 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:49.415542 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:49.415544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.416510 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.416511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:49.417892 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:49.417896 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.418689 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.418690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:49.418788 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:49.418791 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:46:49.418854 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 18:46:49.418903 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":79}
I20260809 18:46:49.418995 20617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.415085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:40521 (local address 127.12.202.195:34027)
0809 18:46:49.415306 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:49.415314 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:49.415386 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:49.415556 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:49.415557 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:49.415559 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:49.415621 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:49.415622 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.416510 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.416511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:49.417893 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:49.417896 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.418689 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.418690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:49.418787 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:49.418791 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:46:49.418854 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 18:46:49.418915 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":121,"thread_start_us":127,"threads_started":1}
I20260809 18:46:49.419039 20594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.415178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:41897 (local address 127.12.202.193:42693)
0809 18:46:49.415226 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:49.415229 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:49.415241 (+ 12us) server_negotiation.cc:407] Connection header received
0809 18:46:49.415278 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:49.415279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:49.415289 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:49.415395 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:49.415627 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.416414 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.418009 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.418581 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.418662 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:49.418672 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:49.418912 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 18:46:49.418961 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:46:49.419039 20595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.415177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:34027 (local address 127.12.202.194:40521)
0809 18:46:49.415250 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:49.415252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:49.415380 (+ 128us) server_negotiation.cc:407] Connection header received
0809 18:46:49.415442 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:49.415443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:49.415452 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:49.415529 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:49.415696 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.416414 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.418009 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.418582 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.418662 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:49.418671 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:49.418911 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 18:46:49.418961 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 18:46:49.419364 20265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b08f8f02cb94b7b8ec81ceef62beec9" candidate_uuid: "039b31619ba749fe839708c9a805da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d5293c45e14d9ebeaa20463725012e" is_pre_election: true
I20260809 18:46:49.419380 20042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b08f8f02cb94b7b8ec81ceef62beec9" candidate_uuid: "039b31619ba749fe839708c9a805da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbd05a5721404070b829057e9b14ffc0" is_pre_election: true
I20260809 18:46:49.419533 20042 raft_consensus.cc:2454] T 3b08f8f02cb94b7b8ec81ceef62beec9 P fbd05a5721404070b829057e9b14ffc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039b31619ba749fe839708c9a805da13 in term 0.
I20260809 18:46:49.419550 20265 raft_consensus.cc:2454] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 039b31619ba749fe839708c9a805da13 in term 0.
I20260809 18:46:49.419759 20381 leader_election.cc:302] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039b31619ba749fe839708c9a805da13, fbd05a5721404070b829057e9b14ffc0; no voters:
I20260809 18:46:49.419909 20613 raft_consensus.cc:2781] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:46:49.419970 20613 raft_consensus.cc:482] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:46:49.420001 20613 raft_consensus.cc:3037] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:49.420847 20613 raft_consensus.cc:504] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039b31619ba749fe839708c9a805da13" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 41301 } } peers { permanent_uuid: "39d5293c45e14d9ebeaa20463725012e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40521 } } peers { permanent_uuid: "fbd05a5721404070b829057e9b14ffc0" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 42693 } }
I20260809 18:46:49.421008 20613 leader_election.cc:288] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [CANDIDATE]: Term 1 election: Requested vote from peers 39d5293c45e14d9ebeaa20463725012e (127.12.202.194:40521), fbd05a5721404070b829057e9b14ffc0 (127.12.202.193:42693)
I20260809 18:46:49.421207 20265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b08f8f02cb94b7b8ec81ceef62beec9" candidate_uuid: "039b31619ba749fe839708c9a805da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d5293c45e14d9ebeaa20463725012e"
I20260809 18:46:49.421262 20042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b08f8f02cb94b7b8ec81ceef62beec9" candidate_uuid: "039b31619ba749fe839708c9a805da13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbd05a5721404070b829057e9b14ffc0"
I20260809 18:46:49.421303 20265 raft_consensus.cc:3037] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:49.421346 20042 raft_consensus.cc:3037] T 3b08f8f02cb94b7b8ec81ceef62beec9 P fbd05a5721404070b829057e9b14ffc0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:49.422282 20265 raft_consensus.cc:2454] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039b31619ba749fe839708c9a805da13 in term 1.
I20260809 18:46:49.422262 20042 raft_consensus.cc:2454] T 3b08f8f02cb94b7b8ec81ceef62beec9 P fbd05a5721404070b829057e9b14ffc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 039b31619ba749fe839708c9a805da13 in term 1.
I20260809 18:46:49.422499 20380 leader_election.cc:302] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 039b31619ba749fe839708c9a805da13, 39d5293c45e14d9ebeaa20463725012e; no voters:
I20260809 18:46:49.422607 20613 raft_consensus.cc:2781] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:49.422755 20613 raft_consensus.cc:686] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [term 1 LEADER]: Becoming Leader. State: Replica: 039b31619ba749fe839708c9a805da13, State: Running, Role: LEADER
I20260809 18:46:49.422853 20613 consensus_queue.cc:237] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039b31619ba749fe839708c9a805da13" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 41301 } } peers { permanent_uuid: "39d5293c45e14d9ebeaa20463725012e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40521 } } peers { permanent_uuid: "fbd05a5721404070b829057e9b14ffc0" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 42693 } }
I20260809 18:46:49.423748 19784 catalog_manager.cc:5495] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 039b31619ba749fe839708c9a805da13 (127.12.202.195). New cstate: current_term: 1 leader_uuid: "039b31619ba749fe839708c9a805da13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "039b31619ba749fe839708c9a805da13" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 41301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39d5293c45e14d9ebeaa20463725012e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbd05a5721404070b829057e9b14ffc0" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 42693 } health_report { overall_health: UNKNOWN } } }
I20260809 18:46:49.448873 20591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.446286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47792 (local address 127.12.202.195:41301)
0809 18:46:49.446359 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:49.446362 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:49.446371 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:46:49.446424 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:49.446425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:49.446445 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:49.446527 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:46:49.446687 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.447185 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.447956 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:49.448152 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:49.448232 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:49.448474 (+ 242us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:46:49.448581 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:46:49.448682 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:49.448701 (+ 19us) server_negotiation.cc:299] Negotiation successful
0809 18:46:49.448723 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 18:46:49.450836 20265 raft_consensus.cc:1261] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e [term 1 FOLLOWER]: Refusing update from remote peer 039b31619ba749fe839708c9a805da13: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:49.450845 20042 raft_consensus.cc:1261] T 3b08f8f02cb94b7b8ec81ceef62beec9 P fbd05a5721404070b829057e9b14ffc0 [term 1 FOLLOWER]: Refusing update from remote peer 039b31619ba749fe839708c9a805da13: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:49.451224 20613 consensus_queue.cc:1035] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39d5293c45e14d9ebeaa20463725012e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:49.451390 20618 consensus_queue.cc:1035] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbd05a5721404070b829057e9b14ffc0" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:49.453810 20622 mvcc.cc:205] Tried to move back new op lower bound from 7316689753907580928 to 7316689753796489216. Current Snapshot: MvccSnapshot[applied={T|T < 7316689753907580928}]
I20260809 18:46:49.454170 20625 mvcc.cc:205] Tried to move back new op lower bound from 7316689753907580928 to 7316689753796489216. Current Snapshot: MvccSnapshot[applied={T|T < 7316689753907580928}]
I20260809 18:46:49.455965 20627 mvcc.cc:205] Tried to move back new op lower bound from 7316689753907580928 to 7316689753796489216. Current Snapshot: MvccSnapshot[applied={T|T < 7316689753907580928 or (T in {7316689753907580928})}]
I20260809 18:46:49.457060 19783 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:46:49.457166 19783 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:46:49.457974 19783 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f4ed23bec8044821bbfd918cb3ae0e9e: Sending DeleteTablet for 3 replicas of tablet 3b08f8f02cb94b7b8ec81ceef62beec9
I20260809 18:46:49.458379 20462 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b08f8f02cb94b7b8ec81ceef62beec9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:49 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:47788
I20260809 18:46:49.458559 20010 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b08f8f02cb94b7b8ec81ceef62beec9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:49 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:56842
I20260809 18:46:49.458621 20637 tablet_replica.cc:330] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13: stopping tablet replica
I20260809 18:46:49.458622 20234 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b08f8f02cb94b7b8ec81ceef62beec9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:49 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:52538
I20260809 18:46:49.458726 20637 raft_consensus.cc:2229] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:46:49.458819 20637 raft_consensus.cc:2258] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:49.458827 20640 tablet_replica.cc:330] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e: stopping tablet replica
I20260809 18:46:49.459018 20640 raft_consensus.cc:2229] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:46:49.459127 20640 raft_consensus.cc:2258] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:49.459268 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 19895
I20260809 18:46:49.459306 20637 ts_tablet_manager.cc:1905] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:49.462230 20640 ts_tablet_manager.cc:1905] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:49.462306 20637 ts_tablet_manager.cc:1918] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:46:49.462385 20637 log.cc:1196] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/3b08f8f02cb94b7b8ec81ceef62beec9
I20260809 18:46:49.462702 20637 ts_tablet_manager.cc:1939] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 039b31619ba749fe839708c9a805da13: Deleting consensus metadata
I20260809 18:46:49.464434 20640 ts_tablet_manager.cc:1918] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:46:49.464511 20640 log.cc:1196] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/3b08f8f02cb94b7b8ec81ceef62beec9
I20260809 18:46:49.464751 20640 ts_tablet_manager.cc:1939] T 3b08f8f02cb94b7b8ec81ceef62beec9 P 39d5293c45e14d9ebeaa20463725012e: Deleting consensus metadata
I20260809 18:46:49.468736 19755 catalog_manager.cc:4841] TS 39d5293c45e14d9ebeaa20463725012e (127.12.202.194:40521): tablet 3b08f8f02cb94b7b8ec81ceef62beec9 (table test-table [id=2e0591d2e5214346b2050577cee646ab]) successfully deleted
I20260809 18:46:49.476235 19755 catalog_manager.cc:4841] TS 039b31619ba749fe839708c9a805da13 (127.12.202.195:41301): tablet 3b08f8f02cb94b7b8ec81ceef62beec9 (table test-table [id=2e0591d2e5214346b2050577cee646ab]) successfully deleted
W20260809 18:46:49.481138 19756 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.202.193:42693 (error 108)
I20260809 18:46:49.481371 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 20124
I20260809 18:46:49.509503 20593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.509250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:42693 (local address 127.0.0.1:56852)
0809 18:46:49.509350 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:49.509443 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:42693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260809 18:46:49.509723 19756 catalog_manager.cc:4584] TS fbd05a5721404070b829057e9b14ffc0 (127.12.202.193:42693): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3b08f8f02cb94b7b8ec81ceef62beec9: Network error: Client connection negotiation failed: client connection to 127.12.202.193:42693: connect: Connection refused (error 111)
I20260809 18:46:49.513914 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 20353
I20260809 18:46:49.525462 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 19732
2026-08-09T18:46:49Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2471 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T18:46:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:46:49Z Disabled control of system clock
I20260809 18:46:49.565121 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:36713
--webserver_interface=127.12.202.254
--webserver_port=0
--builtin_ntp_servers=127.12.202.212:42169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:36713
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 18:46:49.656729 20647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:49.657016 20647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:49.657058 20647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:49.658396 20647 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:46:49.658485 20647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:49.658509 20647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:49.658533 20647 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:46:49.658566 20647 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:46:49.660074 20647 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:42169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:36713
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:36713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:49.660427 20647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:49.660768 20647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:49.666308 20653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:49.666298 20658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:49.666298 20654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:49.666594 20647 server_base.cc:1034] running on GCE node
I20260809 18:46:49.666872 20647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:49.667212 20647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:49.668371 20647 hybrid_clock.cc:648] HybridClock initialized: now 1786301209668354 us; error 45 us; skew 500 ppm
I20260809 18:46:49.669731 20647 webserver.cc:460] Webserver started at http://127.12.202.254:42041/ using document root <none> and password file <none>
I20260809 18:46:49.669996 20647 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:49.670068 20647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:49.670205 20647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:49.671285 20647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "fc80b171cfd84620b7c4b0e236713077"
format_stamp: "Formatted at 2026-08-09 18:46:49 on dist-test-slave-45dx"
server_key: "9e527c85045b3dd4bca9de29c0476012"
server_key_iv: "901b5632d14186922c72a32a1c60a1c5"
server_key_version: "encryptionkey@0"
I20260809 18:46:49.671663 20647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "fc80b171cfd84620b7c4b0e236713077"
format_stamp: "Formatted at 2026-08-09 18:46:49 on dist-test-slave-45dx"
server_key: "9e527c85045b3dd4bca9de29c0476012"
server_key_iv: "901b5632d14186922c72a32a1c60a1c5"
server_key_version: "encryptionkey@0"
I20260809 18:46:49.673079 20647 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:46:49.673828 20671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:49.674002 20647 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:46:49.674105 20647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "fc80b171cfd84620b7c4b0e236713077"
format_stamp: "Formatted at 2026-08-09 18:46:49 on dist-test-slave-45dx"
server_key: "9e527c85045b3dd4bca9de29c0476012"
server_key_iv: "901b5632d14186922c72a32a1c60a1c5"
server_key_version: "encryptionkey@0"
I20260809 18:46:49.674188 20647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:49.677639 20647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:49.677911 20647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:49.678057 20647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:49.682116 20647 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:36713
I20260809 18:46:49.682147 20765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:36713 every 8 connection(s)
I20260809 18:46:49.682498 20647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:46:49.683241 20766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:49.686259 20766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077: Bootstrap starting.
I20260809 18:46:49.686903 20766 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:49.687234 20766 log.cc:824] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:49.687971 20766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077: No bootstrap required, opened a new log
I20260809 18:46:49.689679 20766 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc80b171cfd84620b7c4b0e236713077" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36713 } }
I20260809 18:46:49.689823 20766 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:49.689846 20766 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc80b171cfd84620b7c4b0e236713077, State: Initialized, Role: FOLLOWER
I20260809 18:46:49.690059 20766 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc80b171cfd84620b7c4b0e236713077" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36713 } }
I20260809 18:46:49.690129 20766 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:46:49.690171 20766 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:46:49.690223 20766 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:49.690186 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 20647
I20260809 18:46:49.690312 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:46:49.690508 13099 external_mini_cluster.cc:1428] Setting key b47856af2e7117fe9683f403ea6d4a38
I20260809 18:46:49.690917 20766 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc80b171cfd84620b7c4b0e236713077" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36713 } }
I20260809 18:46:49.691030 20766 leader_election.cc:302] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc80b171cfd84620b7c4b0e236713077; no voters:
I20260809 18:46:49.691210 20766 leader_election.cc:288] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:46:49.691272 20782 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:49.691423 20782 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077 [term 1 LEADER]: Becoming Leader. State: Replica: fc80b171cfd84620b7c4b0e236713077, State: Running, Role: LEADER
I20260809 18:46:49.691504 20766 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:49.691511 20782 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc80b171cfd84620b7c4b0e236713077" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36713 } }
I20260809 18:46:49.691897 20782 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc80b171cfd84620b7c4b0e236713077. Latest consensus state: current_term: 1 leader_uuid: "fc80b171cfd84620b7c4b0e236713077" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc80b171cfd84620b7c4b0e236713077" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36713 } } }
I20260809 18:46:49.691988 20782 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077 [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:49.692239 20783 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc80b171cfd84620b7c4b0e236713077" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc80b171cfd84620b7c4b0e236713077" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36713 } } }
I20260809 18:46:49.692420 20783 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077 [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:49.692874 20787 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:46:49.693361 20773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.691067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36606 (local address 127.12.202.254:36713)
0809 18:46:49.691336 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:49.691346 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:49.691406 (+ 60us) server_negotiation.cc:407] Connection header received
0809 18:46:49.691531 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:49.691538 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:49.691597 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:49.692025 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:49.692645 (+ 620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:49.692648 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:49.692649 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:46:49.692653 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:49.692696 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:46:49.692709 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:49.692999 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:49.693045 (+ 46us) server_negotiation.cc:299] Negotiation successful
0809 18:46:49.693130 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":100,"threads_started":1}
I20260809 18:46:49.693521 20787 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:46:49.695113 20787 catalog_manager.cc:1347] Generated new cluster ID: 15a33027008b4a7cbb508b49af73e487
I20260809 18:46:49.695168 20787 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:46:49.706507 20787 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:46:49.706688 20787 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:46:49.719143 20787 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077: Generated new TSK 0
I20260809 18:46:49.719385 20787 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:46:49.721937 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36713
--builtin_ntp_servers=127.12.202.212:42169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 18:46:49.815485 20817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:49.815764 20817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:49.815820 20817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:49.817137 20817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:49.817216 20817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:49.817265 20817 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:46:49.818779 20817 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:42169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36713
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:49.819063 20817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:49.819365 20817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:49.824632 20824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:49.824620 20823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:49.824800 20832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:49.825004 20817 server_base.cc:1034] running on GCE node
I20260809 18:46:49.825186 20817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:49.825434 20817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:49.826591 20817 hybrid_clock.cc:648] HybridClock initialized: now 1786301209826580 us; error 27 us; skew 500 ppm
I20260809 18:46:49.827978 20817 webserver.cc:460] Webserver started at http://127.12.202.193:33409/ using document root <none> and password file <none>
I20260809 18:46:49.828248 20817 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:49.828351 20817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:49.828526 20817 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:49.829587 20817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "f760dc71bc384b3f8b9fcf4547dde715"
format_stamp: "Formatted at 2026-08-09 18:46:49 on dist-test-slave-45dx"
server_key: "1a0f8c04194032e1ce9d1d2b7f568759"
server_key_iv: "9062dfa786ae31a53916bb9affc5469d"
server_key_version: "encryptionkey@0"
I20260809 18:46:49.829957 20817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "f760dc71bc384b3f8b9fcf4547dde715"
format_stamp: "Formatted at 2026-08-09 18:46:49 on dist-test-slave-45dx"
server_key: "1a0f8c04194032e1ce9d1d2b7f568759"
server_key_iv: "9062dfa786ae31a53916bb9affc5469d"
server_key_version: "encryptionkey@0"
I20260809 18:46:49.831271 20817 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:46:49.831956 20840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:49.832194 20817 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:46:49.832332 20817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "f760dc71bc384b3f8b9fcf4547dde715"
format_stamp: "Formatted at 2026-08-09 18:46:49 on dist-test-slave-45dx"
server_key: "1a0f8c04194032e1ce9d1d2b7f568759"
server_key_iv: "9062dfa786ae31a53916bb9affc5469d"
server_key_version: "encryptionkey@0"
I20260809 18:46:49.832432 20817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:49.835799 20817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:49.836076 20817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:49.836222 20817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:49.836445 20817 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:49.836768 20817 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:49.836828 20817 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:49.836876 20817 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:49.836902 20817 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:49.842681 20817 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:34355
I20260809 18:46:49.842729 21040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:34355 every 8 connection(s)
I20260809 18:46:49.843041 20817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:46:49.845923 20773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.843751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:39051 (local address 127.12.202.254:36713)
0809 18:46:49.843813 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:49.843815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:49.844042 (+ 227us) server_negotiation.cc:407] Connection header received
0809 18:46:49.844553 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:49.844554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:49.844563 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:49.844621 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:49.845730 (+ 1109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:49.845731 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:49.845731 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:46:49.845735 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:49.845752 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:46:49.845755 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:49.845802 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:49.845851 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 18:46:49.845864 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 18:46:49.846139 21044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.843744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36713 (local address 127.12.202.193:39051)
0809 18:46:49.843917 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:49.843950 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:49.844464 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:49.844685 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:49.844688 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:49.844696 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:49.845585 (+ 889us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:46:49.845585 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:49.845613 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:46:49.845643 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:49.845804 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:49.845807 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:49.845809 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:46:49.845857 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 18:46:49.845907 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":78,"threads_started":1}
I20260809 18:46:49.846689 21041 heartbeater.cc:347] Connected to a master server at 127.12.202.254:36713
I20260809 18:46:49.846771 21041 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:49.846957 21041 heartbeater.cc:511] Master 127.12.202.254:36713 requested a full tablet report, sending...
I20260809 18:46:49.847463 20701 ts_manager.cc:194] Registered new tserver with Master: f760dc71bc384b3f8b9fcf4547dde715 (127.12.202.193:34355)
I20260809 18:46:49.848187 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 20817
I20260809 18:46:49.848307 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:46:49.848570 13099 external_mini_cluster.cc:1428] Setting key 3025a62e336a18cbe4b73701557cad73
I20260809 18:46:49.849473 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36713
--builtin_ntp_servers=127.12.202.212:42169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 18:46:49.932682 21046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:49.932894 21046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:49.932917 21046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:49.934208 21046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:49.934248 21046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:49.934274 21046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:46:49.935719 21046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:42169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36713
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:49.935986 21046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:49.936295 21046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:49.941493 21059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:49.941545 21055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:49.941504 21054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:49.941722 21046 server_base.cc:1034] running on GCE node
I20260809 18:46:49.941969 21046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:49.942216 21046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:49.943408 21046 hybrid_clock.cc:648] HybridClock initialized: now 1786301209943393 us; error 27 us; skew 500 ppm
I20260809 18:46:49.949473 21046 webserver.cc:460] Webserver started at http://127.12.202.194:35127/ using document root <none> and password file <none>
I20260809 18:46:49.949726 21046 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:49.949831 21046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:49.949994 21046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:49.951162 21046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "692c5ad34e9d4d928e5bc0cc40963998"
format_stamp: "Formatted at 2026-08-09 18:46:49 on dist-test-slave-45dx"
server_key: "286bd8edc0ba4975120dc4d467b74f7a"
server_key_iv: "a3a7b7a8b873f4351582985408b5c15e"
server_key_version: "encryptionkey@0"
I20260809 18:46:49.951546 21046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "692c5ad34e9d4d928e5bc0cc40963998"
format_stamp: "Formatted at 2026-08-09 18:46:49 on dist-test-slave-45dx"
server_key: "286bd8edc0ba4975120dc4d467b74f7a"
server_key_iv: "a3a7b7a8b873f4351582985408b5c15e"
server_key_version: "encryptionkey@0"
I20260809 18:46:49.953024 21046 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:46:49.953887 21068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:49.954085 21046 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:49.954209 21046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "692c5ad34e9d4d928e5bc0cc40963998"
format_stamp: "Formatted at 2026-08-09 18:46:49 on dist-test-slave-45dx"
server_key: "286bd8edc0ba4975120dc4d467b74f7a"
server_key_iv: "a3a7b7a8b873f4351582985408b5c15e"
server_key_version: "encryptionkey@0"
I20260809 18:46:49.954276 21046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:49.958146 21046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:49.958422 21046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:49.958573 21046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:49.958803 21046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:49.959134 21046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:49.959194 21046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:49.959257 21046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:49.959285 21046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:49.965838 21046 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:34009
I20260809 18:46:49.965891 21257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:34009 every 8 connection(s)
I20260809 18:46:49.966265 21046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:46:49.969584 20773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.967102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:35869 (local address 127.12.202.254:36713)
0809 18:46:49.967168 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:49.967170 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:49.967426 (+ 256us) server_negotiation.cc:407] Connection header received
0809 18:46:49.967931 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:49.967932 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:49.967937 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:49.968000 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:49.969337 (+ 1337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:49.969338 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:49.969338 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:46:49.969343 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:49.969359 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:46:49.969363 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:49.969425 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:49.969513 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 18:46:49.969527 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 18:46:49.969858 21263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:49.967072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36713 (local address 127.12.202.194:35869)
0809 18:46:49.967283 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:49.967329 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:49.967840 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:49.968063 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:49.968067 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:49.968075 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:49.969177 (+ 1102us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:46:49.969178 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:49.969210 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:46:49.969242 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:49.969440 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:49.969445 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:49.969448 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:46:49.969515 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 18:46:49.969571 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":105,"threads_started":1}
I20260809 18:46:49.970441 21259 heartbeater.cc:347] Connected to a master server at 127.12.202.254:36713
I20260809 18:46:49.970557 21259 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:49.970741 21259 heartbeater.cc:511] Master 127.12.202.254:36713 requested a full tablet report, sending...
I20260809 18:46:49.971182 20701 ts_manager.cc:194] Registered new tserver with Master: 692c5ad34e9d4d928e5bc0cc40963998 (127.12.202.194:34009)
I20260809 18:46:49.975050 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 21046
I20260809 18:46:49.975152 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:46:49.975319 13099 external_mini_cluster.cc:1428] Setting key 0241f2c7ea90635f3827eefe4d9d6550
I20260809 18:46:49.976467 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36713
--builtin_ntp_servers=127.12.202.212:42169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 18:46:50.066835 21264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:50.067068 21264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:50.067092 21264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:50.068230 21264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:50.068266 21264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:50.068291 21264 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:46:50.069675 21264 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:42169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36713
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:50.069872 21264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:50.070124 21264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:50.075348 21273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:50.075459 21270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:50.075348 21271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:50.075558 21264 server_base.cc:1034] running on GCE node
I20260809 18:46:50.075774 21264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:50.075999 21264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:50.077138 21264 hybrid_clock.cc:648] HybridClock initialized: now 1786301210077126 us; error 31 us; skew 500 ppm
I20260809 18:46:50.078502 21264 webserver.cc:460] Webserver started at http://127.12.202.195:41447/ using document root <none> and password file <none>
I20260809 18:46:50.078714 21264 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:50.078756 21264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:50.078848 21264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:50.079954 21264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "007dd1466e894bb39ab5afd4e413d3c7"
format_stamp: "Formatted at 2026-08-09 18:46:50 on dist-test-slave-45dx"
server_key: "232c69db3ac933d3919dcc6d2b1266c2"
server_key_iv: "e1faff3eccb27ebf15075c228f80e0cb"
server_key_version: "encryptionkey@0"
I20260809 18:46:50.080269 21264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "007dd1466e894bb39ab5afd4e413d3c7"
format_stamp: "Formatted at 2026-08-09 18:46:50 on dist-test-slave-45dx"
server_key: "232c69db3ac933d3919dcc6d2b1266c2"
server_key_iv: "e1faff3eccb27ebf15075c228f80e0cb"
server_key_version: "encryptionkey@0"
I20260809 18:46:50.081611 21264 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:46:50.082357 21282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:50.082540 21264 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:46:50.082654 21264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "007dd1466e894bb39ab5afd4e413d3c7"
format_stamp: "Formatted at 2026-08-09 18:46:50 on dist-test-slave-45dx"
server_key: "232c69db3ac933d3919dcc6d2b1266c2"
server_key_iv: "e1faff3eccb27ebf15075c228f80e0cb"
server_key_version: "encryptionkey@0"
I20260809 18:46:50.082737 21264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:50.086211 21264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:50.086493 21264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:50.086642 21264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:50.086865 21264 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:50.087188 21264 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:50.087244 21264 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:50.087285 21264 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:50.087313 21264 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:50.093748 21264 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:34179
I20260809 18:46:50.093787 21477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:34179 every 8 connection(s)
I20260809 18:46:50.094125 21264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:46:50.097258 20773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.094862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:52861 (local address 127.12.202.254:36713)
0809 18:46:50.094938 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:50.094939 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:50.095167 (+ 228us) server_negotiation.cc:407] Connection header received
0809 18:46:50.095684 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:50.095686 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:50.095693 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:50.095760 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:50.096978 (+ 1218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:50.096979 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:50.096980 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:46:50.096985 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:50.097002 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:46:50.097006 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:50.097068 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:50.097167 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 18:46:50.097186 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 18:46:50.097465 21481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.094843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36713 (local address 127.12.202.195:52861)
0809 18:46:50.095048 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:50.095080 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:50.095572 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:50.095837 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:50.095840 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:50.095850 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:50.096827 (+ 977us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:46:50.096828 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:50.096855 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:46:50.096881 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:50.097067 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:50.097072 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:50.097075 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:46:50.097175 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 18:46:50.097236 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":89,"threads_started":1}
I20260809 18:46:50.097944 21478 heartbeater.cc:347] Connected to a master server at 127.12.202.254:36713
I20260809 18:46:50.098033 21478 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:50.098207 21478 heartbeater.cc:511] Master 127.12.202.254:36713 requested a full tablet report, sending...
I20260809 18:46:50.098590 20701 ts_manager.cc:194] Registered new tserver with Master: 007dd1466e894bb39ab5afd4e413d3c7 (127.12.202.195:34179)
I20260809 18:46:50.102367 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 21264
I20260809 18:46:50.102487 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:46:50.102669 13099 external_mini_cluster.cc:1428] Setting key 090643f110e319f9bbb7e64701384ce8
I20260809 18:46:50.103513 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:46:50.105971 20773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.104938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36616 (local address 127.12.202.254:36713)
0809 18:46:50.105009 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:50.105011 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:50.105126 (+ 115us) server_negotiation.cc:407] Connection header received
0809 18:46:50.105179 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:50.105179 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:50.105184 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:50.105234 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:50.105788 (+ 554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:50.105789 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:50.105790 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:46:50.105793 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:50.105809 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:46:50.105813 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:50.105866 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:50.105911 (+ 45us) server_negotiation.cc:299] Negotiation successful
0809 18:46:50.105923 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 18:46:50.107688 20701 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36616:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:46:50.109345 20701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:46:50.114171 21500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.111725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:34179 (local address 127.0.0.1:39898)
0809 18:46:50.112087 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:50.112096 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:50.112135 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:50.112469 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:50.112477 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:50.112484 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:50.113622 (+ 1138us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:46:50.113623 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:50.113639 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:46:50.113665 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:50.113934 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:50.113941 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:50.113944 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:46:50.114037 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 18:46:50.114051 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":57,"threads_started":1}
I20260809 18:46:50.114606 21502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.112102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39898 (local address 127.12.202.195:34179)
0809 18:46:50.112295 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:50.112299 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:50.112326 (+ 27us) server_negotiation.cc:407] Connection header received
0809 18:46:50.112350 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:50.112352 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:50.112360 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:50.112691 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:50.113748 (+ 1057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:50.113755 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:50.113756 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:46:50.113760 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:50.113813 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:46:50.113839 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:50.113901 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:50.114470 (+ 569us) server_negotiation.cc:299] Negotiation successful
0809 18:46:50.114488 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":93,"threads_started":1}
I20260809 18:46:50.114888 21501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.111855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37184 (local address 127.12.202.194:34009)
0809 18:46:50.112059 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:50.112064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:50.112076 (+ 12us) server_negotiation.cc:407] Connection header received
0809 18:46:50.112104 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:50.112106 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:50.112116 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:50.112807 (+ 691us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:50.114050 (+ 1243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:50.114058 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:50.114058 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:46:50.114062 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:50.114097 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:46:50.114122 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:50.114184 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:50.114400 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 18:46:50.114420 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":93,"threads_started":1}
I20260809 18:46:50.115043 21495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.111524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:34009 (local address 127.0.0.1:37184)
0809 18:46:50.111715 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:50.111758 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:50.111817 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:50.112625 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:50.112626 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:50.112630 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:50.113949 (+ 1319us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:46:50.113950 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:50.113956 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:46:50.113965 (+ 9us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:50.114216 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:50.114217 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:50.114218 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 18:46:50.114692 (+ 474us) client_negotiation.cc:240] Negotiation successful
0809 18:46:50.114710 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":57,"threads_started":1}
I20260809 18:46:50.115296 21365 tablet_service.cc:1467] Processing CreateTablet for tablet c82c222240f64eb59472beb06244ccd5 (DEFAULT_TABLE table=test-table [id=c73b73ef936241dfbbad269ea1abafff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:50.115697 21365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c82c222240f64eb59472beb06244ccd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:50.115736 21157 tablet_service.cc:1467] Processing CreateTablet for tablet c82c222240f64eb59472beb06244ccd5 (DEFAULT_TABLE table=test-table [id=c73b73ef936241dfbbad269ea1abafff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:50.116150 21157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c82c222240f64eb59472beb06244ccd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:50.119516 21503 tablet_bootstrap.cc:492] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7: Bootstrap starting.
I20260809 18:46:50.120175 21504 tablet_bootstrap.cc:492] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998: Bootstrap starting.
I20260809 18:46:50.120244 21503 tablet_bootstrap.cc:654] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:50.120251 21491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.111530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:34355 (local address 127.0.0.1:60696)
0809 18:46:50.111714 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:50.111758 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:50.111817 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:50.113841 (+ 2024us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:50.113842 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:50.113846 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:50.119809 (+ 5963us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:46:50.119810 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:50.119817 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:46:50.119830 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:50.120126 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:50.120127 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:50.120128 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 18:46:50.120166 (+ 38us) client_negotiation.cc:240] Negotiation successful
0809 18:46:50.120179 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":126,"threads_started":1}
I20260809 18:46:50.120599 21498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.111646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60696 (local address 127.12.202.193:34355)
0809 18:46:50.112292 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:50.112297 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:50.112308 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:46:50.112364 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:50.112366 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:50.112376 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:50.113836 (+ 1460us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:50.119951 (+ 6115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:50.119963 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:50.119963 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:46:50.119969 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:50.120009 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:46:50.120045 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:50.120448 (+ 403us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:50.120479 (+ 31us) server_negotiation.cc:299] Negotiation successful
0809 18:46:50.120499 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":103,"threads_started":1}
I20260809 18:46:50.120891 21504 tablet_bootstrap.cc:654] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:50.120946 21503 log.cc:824] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:50.121194 21504 log.cc:824] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:50.121479 20921 tablet_service.cc:1467] Processing CreateTablet for tablet c82c222240f64eb59472beb06244ccd5 (DEFAULT_TABLE table=test-table [id=c73b73ef936241dfbbad269ea1abafff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:50.121934 20921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c82c222240f64eb59472beb06244ccd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:50.124033 21503 tablet_bootstrap.cc:492] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7: No bootstrap required, opened a new log
I20260809 18:46:50.124109 21503 ts_tablet_manager.cc:1397] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 18:46:50.124899 21504 tablet_bootstrap.cc:492] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998: No bootstrap required, opened a new log
I20260809 18:46:50.124982 21504 ts_tablet_manager.cc:1397] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260809 18:46:50.126026 21508 tablet_bootstrap.cc:492] T c82c222240f64eb59472beb06244ccd5 P f760dc71bc384b3f8b9fcf4547dde715: Bootstrap starting.
I20260809 18:46:50.126741 21508 tablet_bootstrap.cc:654] T c82c222240f64eb59472beb06244ccd5 P f760dc71bc384b3f8b9fcf4547dde715: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:50.127184 21508 log.cc:824] T c82c222240f64eb59472beb06244ccd5 P f760dc71bc384b3f8b9fcf4547dde715: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:50.127799 21504 raft_consensus.cc:348] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692c5ad34e9d4d928e5bc0cc40963998" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34009 } } peers { permanent_uuid: "f760dc71bc384b3f8b9fcf4547dde715" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34355 } } peers { permanent_uuid: "007dd1466e894bb39ab5afd4e413d3c7" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 34179 } }
I20260809 18:46:50.127992 21504 raft_consensus.cc:374] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:50.128048 21504 raft_consensus.cc:729] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 692c5ad34e9d4d928e5bc0cc40963998, State: Initialized, Role: FOLLOWER
I20260809 18:46:50.128175 21504 consensus_queue.cc:260] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692c5ad34e9d4d928e5bc0cc40963998" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34009 } } peers { permanent_uuid: "f760dc71bc384b3f8b9fcf4547dde715" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34355 } } peers { permanent_uuid: "007dd1466e894bb39ab5afd4e413d3c7" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 34179 } }
I20260809 18:46:50.128489 21508 tablet_bootstrap.cc:492] T c82c222240f64eb59472beb06244ccd5 P f760dc71bc384b3f8b9fcf4547dde715: No bootstrap required, opened a new log
I20260809 18:46:50.128486 21504 ts_tablet_manager.cc:1428] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260809 18:46:50.128553 21508 ts_tablet_manager.cc:1397] T c82c222240f64eb59472beb06244ccd5 P f760dc71bc384b3f8b9fcf4547dde715: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:46:50.128536 21259 heartbeater.cc:503] Master 127.12.202.254:36713 was elected leader, sending a full tablet report...
I20260809 18:46:50.130942 21503 raft_consensus.cc:348] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692c5ad34e9d4d928e5bc0cc40963998" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34009 } } peers { permanent_uuid: "f760dc71bc384b3f8b9fcf4547dde715" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34355 } } peers { permanent_uuid: "007dd1466e894bb39ab5afd4e413d3c7" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 34179 } }
I20260809 18:46:50.131099 21503 raft_consensus.cc:374] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:50.131134 21503 raft_consensus.cc:729] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 007dd1466e894bb39ab5afd4e413d3c7, State: Initialized, Role: FOLLOWER
I20260809 18:46:50.131269 21503 consensus_queue.cc:260] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692c5ad34e9d4d928e5bc0cc40963998" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34009 } } peers { permanent_uuid: "f760dc71bc384b3f8b9fcf4547dde715" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34355 } } peers { permanent_uuid: "007dd1466e894bb39ab5afd4e413d3c7" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 34179 } }
I20260809 18:46:50.131619 21478 heartbeater.cc:503] Master 127.12.202.254:36713 was elected leader, sending a full tablet report...
I20260809 18:46:50.131932 21503 ts_tablet_manager.cc:1428] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260809 18:46:50.132311 21508 raft_consensus.cc:348] T c82c222240f64eb59472beb06244ccd5 P f760dc71bc384b3f8b9fcf4547dde715 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692c5ad34e9d4d928e5bc0cc40963998" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34009 } } peers { permanent_uuid: "f760dc71bc384b3f8b9fcf4547dde715" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34355 } } peers { permanent_uuid: "007dd1466e894bb39ab5afd4e413d3c7" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 34179 } }
I20260809 18:46:50.132512 21508 raft_consensus.cc:374] T c82c222240f64eb59472beb06244ccd5 P f760dc71bc384b3f8b9fcf4547dde715 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:50.132561 21508 raft_consensus.cc:729] T c82c222240f64eb59472beb06244ccd5 P f760dc71bc384b3f8b9fcf4547dde715 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f760dc71bc384b3f8b9fcf4547dde715, State: Initialized, Role: FOLLOWER
I20260809 18:46:50.132675 21508 consensus_queue.cc:260] T c82c222240f64eb59472beb06244ccd5 P f760dc71bc384b3f8b9fcf4547dde715 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692c5ad34e9d4d928e5bc0cc40963998" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34009 } } peers { permanent_uuid: "f760dc71bc384b3f8b9fcf4547dde715" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34355 } } peers { permanent_uuid: "007dd1466e894bb39ab5afd4e413d3c7" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 34179 } }
I20260809 18:46:50.132994 21508 ts_tablet_manager.cc:1428] T c82c222240f64eb59472beb06244ccd5 P f760dc71bc384b3f8b9fcf4547dde715: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260809 18:46:50.133057 21041 heartbeater.cc:503] Master 127.12.202.254:36713 was elected leader, sending a full tablet report...
W20260809 18:46:50.216925 21261 tablet.cc:2369] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:46:50.256408 21512 raft_consensus.cc:482] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:46:50.256551 21512 raft_consensus.cc:504] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692c5ad34e9d4d928e5bc0cc40963998" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34009 } } peers { permanent_uuid: "f760dc71bc384b3f8b9fcf4547dde715" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34355 } } peers { permanent_uuid: "007dd1466e894bb39ab5afd4e413d3c7" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 34179 } }
I20260809 18:46:50.257006 21512 leader_election.cc:288] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f760dc71bc384b3f8b9fcf4547dde715 (127.12.202.193:34355), 007dd1466e894bb39ab5afd4e413d3c7 (127.12.202.195:34179)
I20260809 18:46:50.258458 21513 raft_consensus.cc:482] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:46:50.258543 21498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.257377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:34587 (local address 127.12.202.193:34355)
0809 18:46:50.257426 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:50.257429 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:50.257439 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:46:50.257471 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:50.257471 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:50.257477 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:50.257538 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:50.258311 (+ 773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:50.258313 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:50.258313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:46:50.258318 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:50.258338 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:46:50.258343 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:50.258407 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:50.258465 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 18:46:50.258479 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 18:46:50.258543 21263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.257244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:34355 (local address 127.12.202.194:34587)
0809 18:46:50.257324 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:50.257338 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:50.257401 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:50.257566 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:50.257568 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:50.257571 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:50.258174 (+ 603us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:46:50.258174 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:50.258183 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:46:50.258198 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:50.258404 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:50.258405 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:50.258406 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 18:46:50.258453 (+ 47us) client_negotiation.cc:240] Negotiation successful
0809 18:46:50.258469 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 18:46:50.258577 21513 raft_consensus.cc:504] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692c5ad34e9d4d928e5bc0cc40963998" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34009 } } peers { permanent_uuid: "f760dc71bc384b3f8b9fcf4547dde715" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34355 } } peers { permanent_uuid: "007dd1466e894bb39ab5afd4e413d3c7" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 34179 } }
I20260809 18:46:50.258741 21502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.257359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:57017 (local address 127.12.202.195:34179)
0809 18:46:50.257448 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:50.257450 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:50.257775 (+ 325us) server_negotiation.cc:407] Connection header received
0809 18:46:50.257816 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:50.257817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:50.257824 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:50.257877 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:50.258470 (+ 593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:50.258471 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:50.258472 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:46:50.258477 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:50.258494 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:46:50.258498 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:50.258531 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:50.258670 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 18:46:50.258685 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 18:46:50.258941 21517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.257246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:34179 (local address 127.12.202.194:57017)
0809 18:46:50.257651 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:50.257660 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:50.257733 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:50.257904 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:50.257905 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:50.257907 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:50.258351 (+ 444us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:46:50.258352 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:50.258359 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:46:50.258371 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:50.258577 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:50.258578 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:50.258579 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 18:46:50.258850 (+ 271us) client_negotiation.cc:240] Negotiation successful
0809 18:46:50.258866 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"mutex_wait_us":167,"thread_start_us":132,"threads_started":1}
I20260809 18:46:50.258955 21513 leader_election.cc:288] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 692c5ad34e9d4d928e5bc0cc40963998 (127.12.202.194:34009), f760dc71bc384b3f8b9fcf4547dde715 (127.12.202.193:34355)
I20260809 18:46:50.259197 20958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c82c222240f64eb59472beb06244ccd5" candidate_uuid: "692c5ad34e9d4d928e5bc0cc40963998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f760dc71bc384b3f8b9fcf4547dde715" is_pre_election: true
I20260809 18:46:50.259374 20958 raft_consensus.cc:2454] T c82c222240f64eb59472beb06244ccd5 P f760dc71bc384b3f8b9fcf4547dde715 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 692c5ad34e9d4d928e5bc0cc40963998 in term 0.
I20260809 18:46:50.259460 21405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c82c222240f64eb59472beb06244ccd5" candidate_uuid: "692c5ad34e9d4d928e5bc0cc40963998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "007dd1466e894bb39ab5afd4e413d3c7" is_pre_election: true
I20260809 18:46:50.259593 21405 raft_consensus.cc:2454] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 692c5ad34e9d4d928e5bc0cc40963998 in term 0.
I20260809 18:46:50.259662 21075 leader_election.cc:302] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 692c5ad34e9d4d928e5bc0cc40963998, f760dc71bc384b3f8b9fcf4547dde715; no voters:
I20260809 18:46:50.259895 21512 raft_consensus.cc:2781] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:46:50.259958 21512 raft_consensus.cc:482] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:46:50.260011 21512 raft_consensus.cc:3037] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:50.260244 21481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.259067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:34009 (local address 127.12.202.195:55037)
0809 18:46:50.259158 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:50.259167 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:50.259196 (+ 29us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:50.259446 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:50.259447 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:50.259449 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:50.259907 (+ 458us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:46:50.259908 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:50.259915 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:46:50.259927 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:50.260121 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:50.260122 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:50.260123 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 18:46:50.260166 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 18:46:50.260180 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 18:46:50.260618 21501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.259241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:55037 (local address 127.12.202.194:34009)
0809 18:46:50.259304 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:50.259306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:50.259315 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:46:50.259334 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:50.259335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:50.259338 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:50.259392 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:50.260011 (+ 619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:50.260012 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:50.260012 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:46:50.260016 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:50.260032 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:46:50.260036 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:50.260093 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:50.260548 (+ 455us) server_negotiation.cc:299] Negotiation successful
0809 18:46:50.260562 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:46:50.260690 21498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.259500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:42965 (local address 127.12.202.193:34355)
0809 18:46:50.259575 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:50.259577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:50.259586 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:46:50.259605 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:50.259606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:50.259610 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:50.259666 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:50.260444 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:50.260445 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:50.260445 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:46:50.260449 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:50.260462 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:46:50.260465 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:50.260520 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:50.260610 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 18:46:50.260624 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 18:46:50.260702 21518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.259133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:34355 (local address 127.12.202.195:42965)
0809 18:46:50.259312 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:50.259322 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:50.259356 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:50.259714 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:50.259716 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:50.259718 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:50.260250 (+ 532us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:46:50.260257 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:50.260271 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:46:50.260281 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:50.260537 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:50.260538 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:50.260539 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 18:46:50.260605 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 18:46:50.260620 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":81,"threads_started":1}
I20260809 18:46:50.260823 21188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c82c222240f64eb59472beb06244ccd5" candidate_uuid: "007dd1466e894bb39ab5afd4e413d3c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "692c5ad34e9d4d928e5bc0cc40963998" is_pre_election: true
I20260809 18:46:50.260970 20958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c82c222240f64eb59472beb06244ccd5" candidate_uuid: "007dd1466e894bb39ab5afd4e413d3c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f760dc71bc384b3f8b9fcf4547dde715" is_pre_election: true
I20260809 18:46:50.261059 20958 raft_consensus.cc:2454] T c82c222240f64eb59472beb06244ccd5 P f760dc71bc384b3f8b9fcf4547dde715 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 007dd1466e894bb39ab5afd4e413d3c7 in term 0.
I20260809 18:46:50.261229 21285 leader_election.cc:302] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 007dd1466e894bb39ab5afd4e413d3c7, f760dc71bc384b3f8b9fcf4547dde715; no voters:
I20260809 18:46:50.261363 21513 raft_consensus.cc:2781] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:46:50.261445 21513 raft_consensus.cc:482] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:46:50.261482 21513 raft_consensus.cc:3037] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:50.262274 21513 raft_consensus.cc:504] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692c5ad34e9d4d928e5bc0cc40963998" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34009 } } peers { permanent_uuid: "f760dc71bc384b3f8b9fcf4547dde715" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34355 } } peers { permanent_uuid: "007dd1466e894bb39ab5afd4e413d3c7" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 34179 } }
I20260809 18:46:50.262430 21513 leader_election.cc:288] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [CANDIDATE]: Term 1 election: Requested vote from peers 692c5ad34e9d4d928e5bc0cc40963998 (127.12.202.194:34009), f760dc71bc384b3f8b9fcf4547dde715 (127.12.202.193:34355)
I20260809 18:46:50.262612 21187 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c82c222240f64eb59472beb06244ccd5" candidate_uuid: "007dd1466e894bb39ab5afd4e413d3c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "692c5ad34e9d4d928e5bc0cc40963998"
I20260809 18:46:50.262607 20958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c82c222240f64eb59472beb06244ccd5" candidate_uuid: "007dd1466e894bb39ab5afd4e413d3c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f760dc71bc384b3f8b9fcf4547dde715"
I20260809 18:46:50.262691 20958 raft_consensus.cc:3037] T c82c222240f64eb59472beb06244ccd5 P f760dc71bc384b3f8b9fcf4547dde715 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:50.263464 20958 raft_consensus.cc:2454] T c82c222240f64eb59472beb06244ccd5 P f760dc71bc384b3f8b9fcf4547dde715 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 007dd1466e894bb39ab5afd4e413d3c7 in term 1.
I20260809 18:46:50.263625 21285 leader_election.cc:302] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 007dd1466e894bb39ab5afd4e413d3c7, f760dc71bc384b3f8b9fcf4547dde715; no voters: 692c5ad34e9d4d928e5bc0cc40963998
I20260809 18:46:50.263720 21513 raft_consensus.cc:2781] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:50.263873 21513 raft_consensus.cc:686] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [term 1 LEADER]: Becoming Leader. State: Replica: 007dd1466e894bb39ab5afd4e413d3c7, State: Running, Role: LEADER
I20260809 18:46:50.263979 21513 consensus_queue.cc:237] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692c5ad34e9d4d928e5bc0cc40963998" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34009 } } peers { permanent_uuid: "f760dc71bc384b3f8b9fcf4547dde715" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34355 } } peers { permanent_uuid: "007dd1466e894bb39ab5afd4e413d3c7" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 34179 } }
I20260809 18:46:50.265767 21512 raft_consensus.cc:504] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692c5ad34e9d4d928e5bc0cc40963998" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34009 } } peers { permanent_uuid: "f760dc71bc384b3f8b9fcf4547dde715" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34355 } } peers { permanent_uuid: "007dd1466e894bb39ab5afd4e413d3c7" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 34179 } }
I20260809 18:46:50.266018 21188 raft_consensus.cc:2379] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 007dd1466e894bb39ab5afd4e413d3c7 in current term 1: Already voted for candidate 692c5ad34e9d4d928e5bc0cc40963998 in this term.
I20260809 18:46:50.266081 20958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c82c222240f64eb59472beb06244ccd5" candidate_uuid: "692c5ad34e9d4d928e5bc0cc40963998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f760dc71bc384b3f8b9fcf4547dde715"
I20260809 18:46:50.266151 20958 raft_consensus.cc:2379] T c82c222240f64eb59472beb06244ccd5 P f760dc71bc384b3f8b9fcf4547dde715 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 692c5ad34e9d4d928e5bc0cc40963998 in current term 1: Already voted for candidate 007dd1466e894bb39ab5afd4e413d3c7 in this term.
I20260809 18:46:50.266034 20701 catalog_manager.cc:5495] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 007dd1466e894bb39ab5afd4e413d3c7 (127.12.202.195). New cstate: current_term: 1 leader_uuid: "007dd1466e894bb39ab5afd4e413d3c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692c5ad34e9d4d928e5bc0cc40963998" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f760dc71bc384b3f8b9fcf4547dde715" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "007dd1466e894bb39ab5afd4e413d3c7" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 34179 } health_report { overall_health: HEALTHY } } }
I20260809 18:46:50.266141 21405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c82c222240f64eb59472beb06244ccd5" candidate_uuid: "692c5ad34e9d4d928e5bc0cc40963998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "007dd1466e894bb39ab5afd4e413d3c7"
I20260809 18:46:50.266476 21076 leader_election.cc:302] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 692c5ad34e9d4d928e5bc0cc40963998; no voters: 007dd1466e894bb39ab5afd4e413d3c7, f760dc71bc384b3f8b9fcf4547dde715
I20260809 18:46:50.266624 21512 leader_election.cc:288] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [CANDIDATE]: Term 1 election: Requested vote from peers f760dc71bc384b3f8b9fcf4547dde715 (127.12.202.193:34355), 007dd1466e894bb39ab5afd4e413d3c7 (127.12.202.195:34179)
I20260809 18:46:50.266728 21524 raft_consensus.cc:2726] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260809 18:46:50.297451 21502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.296414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39912 (local address 127.12.202.195:34179)
0809 18:46:50.296464 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:50.296466 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:50.296474 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:46:50.296548 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:50.296549 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:50.296567 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:50.296618 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:50.297176 (+ 558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:50.297178 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:50.297178 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:46:50.297182 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:50.297200 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:46:50.297204 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:50.297255 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:50.297292 (+ 37us) server_negotiation.cc:299] Negotiation successful
0809 18:46:50.297306 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 18:46:50.299490 21188 raft_consensus.cc:1261] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [term 1 FOLLOWER]: Refusing update from remote peer 007dd1466e894bb39ab5afd4e413d3c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:50.299503 20958 raft_consensus.cc:1261] T c82c222240f64eb59472beb06244ccd5 P f760dc71bc384b3f8b9fcf4547dde715 [term 1 FOLLOWER]: Refusing update from remote peer 007dd1466e894bb39ab5afd4e413d3c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:50.299777 21521 consensus_queue.cc:1035] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "692c5ad34e9d4d928e5bc0cc40963998" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:50.299942 21513 consensus_queue.cc:1035] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f760dc71bc384b3f8b9fcf4547dde715" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:50.302517 21528 mvcc.cc:205] Tried to move back new op lower bound from 7316689757383819264 to 7316689757241835520. Current Snapshot: MvccSnapshot[applied={T|T < 7316689757383819264}]
I20260809 18:46:50.302889 21534 mvcc.cc:205] Tried to move back new op lower bound from 7316689757383819264 to 7316689757241835520. Current Snapshot: MvccSnapshot[applied={T|T < 7316689757383819264}]
I20260809 18:46:50.303022 21531 mvcc.cc:205] Tried to move back new op lower bound from 7316689757383819264 to 7316689757241835520. Current Snapshot: MvccSnapshot[applied={T|T < 7316689757383819264}]
I20260809 18:46:50.305208 20700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:46:50.305315 20700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:46:50.306097 20700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc80b171cfd84620b7c4b0e236713077: Sending DeleteTablet for 3 replicas of tablet c82c222240f64eb59472beb06244ccd5
I20260809 18:46:50.306476 20921 tablet_service.cc:1514] Processing DeleteTablet for tablet c82c222240f64eb59472beb06244ccd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:50 UTC) from {username='slave'} at 127.0.0.1:60696
I20260809 18:46:50.306519 21157 tablet_service.cc:1514] Processing DeleteTablet for tablet c82c222240f64eb59472beb06244ccd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:50 UTC) from {username='slave'} at 127.0.0.1:37184
I20260809 18:46:50.306703 21546 tablet_replica.cc:330] T c82c222240f64eb59472beb06244ccd5 P f760dc71bc384b3f8b9fcf4547dde715: stopping tablet replica
I20260809 18:46:50.306704 21365 tablet_service.cc:1514] Processing DeleteTablet for tablet c82c222240f64eb59472beb06244ccd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:50 UTC) from {username='slave'} at 127.0.0.1:39898
I20260809 18:46:50.306717 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 20817
I20260809 18:46:50.306806 21546 raft_consensus.cc:2229] T c82c222240f64eb59472beb06244ccd5 P f760dc71bc384b3f8b9fcf4547dde715 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:46:50.306902 21549 tablet_replica.cc:330] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7: stopping tablet replica
I20260809 18:46:50.306986 21549 raft_consensus.cc:2229] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:46:50.307273 21548 tablet_replica.cc:330] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998: stopping tablet replica
I20260809 18:46:50.307359 21548 raft_consensus.cc:2229] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:46:50.307440 21548 raft_consensus.cc:2258] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:50.307581 21549 raft_consensus.cc:2258] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:50.312525 21549 ts_tablet_manager.cc:1905] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:50.314775 21549 ts_tablet_manager.cc:1918] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:46:50.314854 21549 log.cc:1196] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/c82c222240f64eb59472beb06244ccd5
I20260809 18:46:50.315105 21549 ts_tablet_manager.cc:1939] T c82c222240f64eb59472beb06244ccd5 P 007dd1466e894bb39ab5afd4e413d3c7: Deleting consensus metadata
I20260809 18:46:50.315490 20676 catalog_manager.cc:4841] TS 007dd1466e894bb39ab5afd4e413d3c7 (127.12.202.195:34179): tablet c82c222240f64eb59472beb06244ccd5 (table test-table [id=c73b73ef936241dfbbad269ea1abafff]) successfully deleted
I20260809 18:46:50.318051 21548 ts_tablet_manager.cc:1905] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:50.319451 21548 ts_tablet_manager.cc:1918] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:46:50.319522 21548 log.cc:1196] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/c82c222240f64eb59472beb06244ccd5
I20260809 18:46:50.319808 21548 ts_tablet_manager.cc:1939] T c82c222240f64eb59472beb06244ccd5 P 692c5ad34e9d4d928e5bc0cc40963998: Deleting consensus metadata
I20260809 18:46:50.320279 20676 catalog_manager.cc:4841] TS 692c5ad34e9d4d928e5bc0cc40963998 (127.12.202.194:34009): tablet c82c222240f64eb59472beb06244ccd5 (table test-table [id=c73b73ef936241dfbbad269ea1abafff]) successfully deleted
W20260809 18:46:50.331161 20674 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.202.193:34355 (error 108)
I20260809 18:46:50.331480 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 21046
I20260809 18:46:50.333359 21491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.331622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:34355 (local address 127.0.0.1:60698)
0809 18:46:50.333246 (+ 1624us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:50.333313 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:34355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1601}
W20260809 18:46:50.333487 20674 catalog_manager.cc:4584] TS f760dc71bc384b3f8b9fcf4547dde715 (127.12.202.193:34355): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c82c222240f64eb59472beb06244ccd5: Network error: Client connection negotiation failed: client connection to 127.12.202.193:34355: connect: Connection refused (error 111)
I20260809 18:46:50.339507 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 21264
I20260809 18:46:50.349530 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 20647
2026-08-09T18:46:50Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (821 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 18:46:50.378746 13099 mini_oidc.cc:152] Starting JWKS server
I20260809 18:46:50.380002 13099 webserver.cc:460] Webserver started at https://127.0.0.1:40813/ using document root <none> and password file <none>
I20260809 18:46:50.380163 13099 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 18:46:50.380442 13099 webserver.cc:460] Webserver started at http://127.0.0.1:40745/ using document root <none> and password file <none>
2026-08-09T18:46:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:46:50Z Disabled control of system clock
I20260809 18:46:50.389873 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:32949
--webserver_interface=127.12.202.254
--webserver_port=0
--builtin_ntp_servers=127.12.202.212:34351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:32949
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40813/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/testchainca.cert with env {}
W20260809 18:46:50.474709 21561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:50.474926 21561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:50.474948 21561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:50.476043 21561 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:46:50.476075 21561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:50.476089 21561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:50.476101 21561 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:46:50.476114 21561 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 18:46:50.476126 21561 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 18:46:50.476137 21561 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40813/jwks.json
I20260809 18:46:50.477645 21561 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:34351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:32949
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:32949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40813/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:50.477851 21561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:50.478027 21561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:50.482991 21568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:50.482997 21571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:50.482997 21567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:50.483244 21561 server_base.cc:1034] running on GCE node
I20260809 18:46:50.483556 21561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:50.483878 21561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:50.485023 21561 hybrid_clock.cc:648] HybridClock initialized: now 1786301210484996 us; error 47 us; skew 500 ppm
I20260809 18:46:50.486299 21561 webserver.cc:460] Webserver started at http://127.12.202.254:40483/ using document root <none> and password file <none>
I20260809 18:46:50.486557 21561 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:50.486604 21561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:50.486760 21561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:50.487795 21561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "e7d89baf09d64ef29d995ef04ba25daa"
format_stamp: "Formatted at 2026-08-09 18:46:50 on dist-test-slave-45dx"
server_key: "d42a7ea9191ae1c2fafbd61c7b6093c4"
server_key_iv: "2d786af14fb31029254111dc373ae3c8"
server_key_version: "encryptionkey@0"
I20260809 18:46:50.488163 21561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "e7d89baf09d64ef29d995ef04ba25daa"
format_stamp: "Formatted at 2026-08-09 18:46:50 on dist-test-slave-45dx"
server_key: "d42a7ea9191ae1c2fafbd61c7b6093c4"
server_key_iv: "2d786af14fb31029254111dc373ae3c8"
server_key_version: "encryptionkey@0"
I20260809 18:46:50.489538 21561 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:46:50.490286 21583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:50.490554 21561 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:46:50.490680 21561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "e7d89baf09d64ef29d995ef04ba25daa"
format_stamp: "Formatted at 2026-08-09 18:46:50 on dist-test-slave-45dx"
server_key: "d42a7ea9191ae1c2fafbd61c7b6093c4"
server_key_iv: "2d786af14fb31029254111dc373ae3c8"
server_key_version: "encryptionkey@0"
I20260809 18:46:50.490788 21561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:50.500917 21561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:50.501197 21561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:50.501353 21561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:50.505292 21561 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:32949
I20260809 18:46:50.505322 21671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:32949 every 8 connection(s)
I20260809 18:46:50.505650 21561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:46:50.506709 21672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:50.509807 21672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa: Bootstrap starting.
I20260809 18:46:50.510556 21672 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:50.510931 21672 log.cc:824] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:50.511744 21672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa: No bootstrap required, opened a new log
I20260809 18:46:50.514351 21672 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d89baf09d64ef29d995ef04ba25daa" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32949 } }
I20260809 18:46:50.514509 21672 raft_consensus.cc:374] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:50.514541 21672 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7d89baf09d64ef29d995ef04ba25daa, State: Initialized, Role: FOLLOWER
I20260809 18:46:50.514696 21672 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d89baf09d64ef29d995ef04ba25daa" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32949 } }
I20260809 18:46:50.514758 21672 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:46:50.514786 21672 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:46:50.514825 21672 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:50.515542 21672 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d89baf09d64ef29d995ef04ba25daa" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32949 } }
I20260809 18:46:50.515631 21672 leader_election.cc:302] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7d89baf09d64ef29d995ef04ba25daa; no voters:
I20260809 18:46:50.516556 21672 leader_election.cc:288] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:46:50.516592 21676 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:50.516697 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 21561
I20260809 18:46:50.516741 21676 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa [term 1 LEADER]: Becoming Leader. State: Replica: e7d89baf09d64ef29d995ef04ba25daa, State: Running, Role: LEADER
I20260809 18:46:50.516808 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:46:50.516830 21676 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d89baf09d64ef29d995ef04ba25daa" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32949 } }
I20260809 18:46:50.516875 21672 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:50.516988 13099 external_mini_cluster.cc:1428] Setting key fe0054833330cbe8d0d1fc36514ab9ee
I20260809 18:46:50.517884 21677 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e7d89baf09d64ef29d995ef04ba25daa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d89baf09d64ef29d995ef04ba25daa" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32949 } } }
I20260809 18:46:50.517983 21677 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:50.517885 21676 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7d89baf09d64ef29d995ef04ba25daa. Latest consensus state: current_term: 1 leader_uuid: "e7d89baf09d64ef29d995ef04ba25daa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7d89baf09d64ef29d995ef04ba25daa" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32949 } } }
I20260809 18:46:50.518108 21676 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa [sys.catalog]: This master's current role is: LEADER
W20260809 18:46:50.518817 21699 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:46:50.518863 21699 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:46:50.518934 21696 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:46:50.519131 21696 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:46:50.523736 21689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.517714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60024 (local address 127.12.202.254:32949)
0809 18:46:50.518360 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:50.518371 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:50.518583 (+ 212us) server_negotiation.cc:407] Connection header received
0809 18:46:50.518713 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:50.518722 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:50.518795 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:50.518939 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:50.519272 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:50.520736 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:50.521808 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:50.522199 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:50.522343 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:50.523079 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:50.523082 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:50.523083 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:46:50.523268 (+ 185us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:50.523301 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:46:50.523311 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:50.523390 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:50.523465 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 18:46:50.523542 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":83,"threads_started":1}
I20260809 18:46:50.525167 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:46:50.528718 21696 catalog_manager.cc:1347] Generated new cluster ID: f33f695fb30e45afa448430514c49e95
I20260809 18:46:50.528797 21696 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:46:50.538937 21696 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:46:50.539613 21696 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:46:50.549094 21696 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e7d89baf09d64ef29d995ef04ba25daa: Generated new TSK 0
I20260809 18:46:50.549265 21696 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 18:46:50.578047 21714 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 18:46:50.578181 21714 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 18:46:50.578438 21689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.555251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60038 (local address 127.12.202.254:32949)
0809 18:46:50.555295 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:50.555297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:50.555447 (+ 150us) server_negotiation.cc:407] Connection header received
0809 18:46:50.555541 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:50.555541 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:50.555552 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:50.555610 (+ 58us) server_negotiation.cc:226] Negotiated authn=JWT
0809 18:46:50.555773 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:50.556264 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:50.557443 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:50.557624 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:50.557683 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:50.557915 (+ 232us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 18:46:50.577988 (+ 20073us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40813/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 18:46:50.578372 (+ 384us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60038: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40813/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":24}
W20260809 18:46:50.578509 21689 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60038: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40813/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 18:46:50.578719 21713 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:46:50.555150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:32949 (local address 127.0.0.1:60038)
0809 18:46:50.555369 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:50.555381 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:50.555453 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:50.555636 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:50.555637 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:50.555639 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0809 18:46:50.555706 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:50.555708 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:50.556411 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:50.556412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:50.557353 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:50.557356 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:50.557719 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:50.557721 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:50.557787 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:50.557810 (+ 23us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 18:46:50.578131 (+ 20321us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40813/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 18:46:50.578242 (+ 111us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.202.254:32949: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40813/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":109,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.12.202.254:32949: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40813/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 18:46:50.579121 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 21561
2026-08-09T18:46:50Z chronyd exiting
I20260809 18:46:50.636070 13099 test_util.cc:175] -----------------------------------------------
I20260809 18:46:50.636153 13099 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786301184679835-13099-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (258 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 18:46:50.636976 13099 mini_oidc.cc:152] Starting JWKS server
I20260809 18:46:50.637615 13099 webserver.cc:460] Webserver started at https://127.0.0.1:34773/ using document root <none> and password file <none>
I20260809 18:46:50.637673 13099 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 18:46:50.637823 13099 webserver.cc:460] Webserver started at http://127.0.0.1:44413/ using document root <none> and password file <none>
2026-08-09T18:46:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:46:50Z Disabled control of system clock
I20260809 18:46:50.646661 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:43383
--webserver_interface=127.12.202.254
--webserver_port=0
--builtin_ntp_servers=127.12.202.212:44643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:43383
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34773/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/testchainca.cert with env {}
W20260809 18:46:50.730311 21726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:50.730576 21726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:50.730613 21726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:50.731809 21726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:46:50.731877 21726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:50.731899 21726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:50.731920 21726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:46:50.731952 21726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 18:46:50.731982 21726 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 18:46:50.732007 21726 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34773/jwks.json
I20260809 18:46:50.733528 21726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:44643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:43383
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:43383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34773/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:50.733839 21726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:50.734071 21726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:50.739061 21735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:50.739264 21726 server_base.cc:1034] running on GCE node
W20260809 18:46:50.739061 21736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:50.739070 21739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:50.739622 21726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:50.739924 21726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:50.741109 21726 hybrid_clock.cc:648] HybridClock initialized: now 1786301210741095 us; error 28 us; skew 500 ppm
I20260809 18:46:50.742596 21726 webserver.cc:460] Webserver started at http://127.12.202.254:35059/ using document root <none> and password file <none>
I20260809 18:46:50.742854 21726 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:50.742930 21726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:50.743081 21726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:50.744149 21726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "e9ec41e7d8f64443ba49770266752be0"
format_stamp: "Formatted at 2026-08-09 18:46:50 on dist-test-slave-45dx"
server_key: "5596cc5fb28d8a649613f1fb9e6d8fa9"
server_key_iv: "253f57dd8efaf2aa5ed19b069a3308d4"
server_key_version: "encryptionkey@0"
I20260809 18:46:50.744555 21726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "e9ec41e7d8f64443ba49770266752be0"
format_stamp: "Formatted at 2026-08-09 18:46:50 on dist-test-slave-45dx"
server_key: "5596cc5fb28d8a649613f1fb9e6d8fa9"
server_key_iv: "253f57dd8efaf2aa5ed19b069a3308d4"
server_key_version: "encryptionkey@0"
I20260809 18:46:50.745889 21726 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:46:50.746692 21747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:50.746887 21726 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:46:50.747002 21726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "e9ec41e7d8f64443ba49770266752be0"
format_stamp: "Formatted at 2026-08-09 18:46:50 on dist-test-slave-45dx"
server_key: "5596cc5fb28d8a649613f1fb9e6d8fa9"
server_key_iv: "253f57dd8efaf2aa5ed19b069a3308d4"
server_key_version: "encryptionkey@0"
I20260809 18:46:50.747080 21726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:50.768740 21726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:50.769140 21726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:50.769305 21726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:50.773639 21726 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:43383
I20260809 18:46:50.773687 21828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:43383 every 8 connection(s)
I20260809 18:46:50.774070 21726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:46:50.774816 21829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:50.778267 21829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0: Bootstrap starting.
I20260809 18:46:50.778841 21829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:50.779111 21829 log.cc:824] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:50.779791 21829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0: No bootstrap required, opened a new log
I20260809 18:46:50.781517 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 21726
I20260809 18:46:50.781646 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:46:50.781518 21829 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9ec41e7d8f64443ba49770266752be0" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43383 } }
I20260809 18:46:50.781702 21829 raft_consensus.cc:374] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:50.781772 21829 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9ec41e7d8f64443ba49770266752be0, State: Initialized, Role: FOLLOWER
I20260809 18:46:50.781881 13099 external_mini_cluster.cc:1428] Setting key 7fbce67598a7a04ebc39dbd1b447a583
I20260809 18:46:50.781966 21829 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9ec41e7d8f64443ba49770266752be0" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43383 } }
I20260809 18:46:50.782059 21829 raft_consensus.cc:388] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:46:50.782122 21829 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:46:50.782181 21829 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:50.782920 21829 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9ec41e7d8f64443ba49770266752be0" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43383 } }
I20260809 18:46:50.783043 21829 leader_election.cc:302] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e9ec41e7d8f64443ba49770266752be0; no voters:
I20260809 18:46:50.783200 21829 leader_election.cc:288] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:46:50.783265 21836 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:50.783425 21836 raft_consensus.cc:686] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0 [term 1 LEADER]: Becoming Leader. State: Replica: e9ec41e7d8f64443ba49770266752be0, State: Running, Role: LEADER
I20260809 18:46:50.783471 21829 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:50.783514 21836 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9ec41e7d8f64443ba49770266752be0" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43383 } }
I20260809 18:46:50.783866 21837 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e9ec41e7d8f64443ba49770266752be0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9ec41e7d8f64443ba49770266752be0" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43383 } } }
I20260809 18:46:50.783855 21836 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9ec41e7d8f64443ba49770266752be0. Latest consensus state: current_term: 1 leader_uuid: "e9ec41e7d8f64443ba49770266752be0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9ec41e7d8f64443ba49770266752be0" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43383 } } }
I20260809 18:46:50.784047 21837 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0 [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:50.784065 21836 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0 [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:50.784446 21847 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:46:50.785018 21847 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:46:50.787070 21847 catalog_manager.cc:1347] Generated new cluster ID: d2d0838c575b41a99e6f0c0afda99133
I20260809 18:46:50.787125 21847 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:46:50.789088 21835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.782655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36810 (local address 127.12.202.254:43383)
0809 18:46:50.782920 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:50.782929 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:50.782966 (+ 37us) server_negotiation.cc:407] Connection header received
0809 18:46:50.783084 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:50.783091 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:50.783170 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:50.783336 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:50.783713 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:50.785773 (+ 2060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:50.786744 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:50.787331 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:50.787460 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:50.788173 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:50.788177 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:50.788177 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:46:50.788423 (+ 246us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:50.788470 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:46:50.788485 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:50.788560 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:50.788643 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 18:46:50.788846 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":105,"threads_started":1}
I20260809 18:46:50.790033 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:46:50.793563 21847 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:46:50.794057 21847 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:46:50.797794 21847 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e9ec41e7d8f64443ba49770266752be0: Generated new TSK 0
I20260809 18:46:50.797981 21847 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 18:46:50.819231 21876 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 18:46:50.819339 21876 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 18:46:50.819674 21835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:50.804184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36826 (local address 127.12.202.254:43383)
0809 18:46:50.804264 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:50.804266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:50.804343 (+ 77us) server_negotiation.cc:407] Connection header received
0809 18:46:50.804469 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:50.804470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:50.804484 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:50.804563 (+ 79us) server_negotiation.cc:226] Negotiated authn=JWT
0809 18:46:50.804677 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:50.805466 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:50.806266 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:50.806609 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:50.806681 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:50.806825 (+ 144us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 18:46:50.819434 (+ 12609us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34773/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 18:46:50.819587 (+ 153us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36826: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34773/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":37}
W20260809 18:46:50.819742 21835 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36826: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34773/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260809 18:46:50.819716 21874 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:46:50.804092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43383 (local address 127.0.0.1:36826)
0809 18:46:50.804251 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:50.804261 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:50.804373 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:50.804560 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:50.804561 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:50.804562 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0809 18:46:50.804618 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:50.804620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:50.805576 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:50.805577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:50.806172 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:50.806173 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:50.806687 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:50.806688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:50.806730 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:50.806734 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 18:46:50.819557 (+ 12823us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34773/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 18:46:50.819641 (+ 84us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.202.254:43383: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34773/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":93,"threads_started":1}
I20260809 18:46:50.820245 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 21726
2026-08-09T18:46:50Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (229 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 18:46:50.867054 13099 mini_oidc.cc:152] Starting JWKS server
I20260809 18:46:50.867795 13099 webserver.cc:460] Webserver started at https://127.0.0.1:38793/ using document root <none> and password file <none>
I20260809 18:46:50.867874 13099 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 18:46:50.868045 13099 webserver.cc:460] Webserver started at http://127.0.0.1:39935/ using document root <none> and password file <none>
2026-08-09T18:46:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:46:50Z Disabled control of system clock
I20260809 18:46:50.876895 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:39847
--webserver_interface=127.12.202.254
--webserver_port=0
--builtin_ntp_servers=127.12.202.212:35369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:39847
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38793/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 18:46:50.958437 21888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:50.958629 21888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:50.958650 21888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:50.959697 21888 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:46:50.959729 21888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:50.959741 21888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:50.959754 21888 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:46:50.959766 21888 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 18:46:50.959779 21888 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 18:46:50.959789 21888 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38793/jwks.json
I20260809 18:46:50.961076 21888 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:35369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:39847
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:39847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38793/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:50.961280 21888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:50.961517 21888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:50.966459 21894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:50.966480 21897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:50.966502 21888 server_base.cc:1034] running on GCE node
W20260809 18:46:50.966470 21899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:50.966948 21888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:50.967245 21888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:50.968394 21888 hybrid_clock.cc:648] HybridClock initialized: now 1786301210968382 us; error 49 us; skew 500 ppm
I20260809 18:46:50.969947 21888 webserver.cc:460] Webserver started at http://127.12.202.254:32851/ using document root <none> and password file <none>
I20260809 18:46:50.970234 21888 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:50.970327 21888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:50.970486 21888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:50.971606 21888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "fccd1d0ac367402ab2634b6d751d1bae"
format_stamp: "Formatted at 2026-08-09 18:46:50 on dist-test-slave-45dx"
server_key: "8e04aaf2ffb74565af23383f07bf70c7"
server_key_iv: "9c4727a091756688d5312f99beae5ad2"
server_key_version: "encryptionkey@0"
I20260809 18:46:50.972024 21888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "fccd1d0ac367402ab2634b6d751d1bae"
format_stamp: "Formatted at 2026-08-09 18:46:50 on dist-test-slave-45dx"
server_key: "8e04aaf2ffb74565af23383f07bf70c7"
server_key_iv: "9c4727a091756688d5312f99beae5ad2"
server_key_version: "encryptionkey@0"
I20260809 18:46:50.973418 21888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:46:50.974179 21911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:50.974359 21888 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:50.974453 21888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "fccd1d0ac367402ab2634b6d751d1bae"
format_stamp: "Formatted at 2026-08-09 18:46:50 on dist-test-slave-45dx"
server_key: "8e04aaf2ffb74565af23383f07bf70c7"
server_key_iv: "9c4727a091756688d5312f99beae5ad2"
server_key_version: "encryptionkey@0"
I20260809 18:46:50.974537 21888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:50.991632 21888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:50.991935 21888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:50.992092 21888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:50.996089 21888 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:39847
I20260809 18:46:50.996145 22001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:39847 every 8 connection(s)
I20260809 18:46:50.996532 21888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:46:50.997228 22003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:51.000025 22003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae: Bootstrap starting.
I20260809 18:46:51.000643 22003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:51.000888 22003 log.cc:824] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:51.001116 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 21888
I20260809 18:46:51.001230 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:46:51.001422 13099 external_mini_cluster.cc:1428] Setting key a42e80d8d59d6f4f850912152d955aed
I20260809 18:46:51.001703 22003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae: No bootstrap required, opened a new log
I20260809 18:46:51.004796 22003 raft_consensus.cc:348] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fccd1d0ac367402ab2634b6d751d1bae" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39847 } }
I20260809 18:46:51.004966 22003 raft_consensus.cc:374] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:51.004997 22003 raft_consensus.cc:729] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fccd1d0ac367402ab2634b6d751d1bae, State: Initialized, Role: FOLLOWER
I20260809 18:46:51.005112 22003 consensus_queue.cc:260] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fccd1d0ac367402ab2634b6d751d1bae" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39847 } }
I20260809 18:46:51.005191 22003 raft_consensus.cc:388] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:46:51.005230 22003 raft_consensus.cc:482] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:46:51.005290 22003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:51.005878 22003 raft_consensus.cc:504] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fccd1d0ac367402ab2634b6d751d1bae" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39847 } }
I20260809 18:46:51.006008 22003 leader_election.cc:302] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fccd1d0ac367402ab2634b6d751d1bae; no voters:
I20260809 18:46:51.006170 22003 leader_election.cc:288] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:46:51.006238 22013 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:51.006389 22013 raft_consensus.cc:686] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae [term 1 LEADER]: Becoming Leader. State: Replica: fccd1d0ac367402ab2634b6d751d1bae, State: Running, Role: LEADER
I20260809 18:46:51.006412 22003 sys_catalog.cc:564] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:51.006476 22013 consensus_queue.cc:237] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fccd1d0ac367402ab2634b6d751d1bae" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39847 } }
I20260809 18:46:51.006795 22013 sys_catalog.cc:455] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae [sys.catalog]: SysCatalogTable state changed. Reason: New leader fccd1d0ac367402ab2634b6d751d1bae. Latest consensus state: current_term: 1 leader_uuid: "fccd1d0ac367402ab2634b6d751d1bae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fccd1d0ac367402ab2634b6d751d1bae" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39847 } } }
I20260809 18:46:51.006868 22013 sys_catalog.cc:458] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:51.007139 22018 sys_catalog.cc:455] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fccd1d0ac367402ab2634b6d751d1bae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fccd1d0ac367402ab2634b6d751d1bae" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39847 } } }
I20260809 18:46:51.007689 22033 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:46:51.007292 22018 sys_catalog.cc:458] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:51.008203 22033 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:46:51.008388 22010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:51.001968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52620 (local address 127.12.202.254:39847)
0809 18:46:51.002209 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:51.002217 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:51.002251 (+ 34us) server_negotiation.cc:407] Connection header received
0809 18:46:51.003246 (+ 995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:51.003256 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:51.003334 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:51.003520 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:51.003696 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:51.005137 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:51.005978 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:51.006608 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:51.006772 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:51.007503 (+ 731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:51.007508 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:51.007508 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:46:51.007730 (+ 222us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:51.007783 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:46:51.007800 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:51.007862 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:51.008036 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 18:46:51.008113 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":102,"threads_started":1}
I20260809 18:46:51.009408 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:46:51.009968 22033 catalog_manager.cc:1347] Generated new cluster ID: 40883d3c5a18443391e1c2b9b80d9de0
I20260809 18:46:51.010025 22033 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:46:51.020498 22033 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:46:51.020977 22033 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:46:51.024870 22033 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fccd1d0ac367402ab2634b6d751d1bae: Generated new TSK 0
I20260809 18:46:51.025048 22033 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:46:51.037981 22010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:51.034441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52628 (local address 127.12.202.254:39847)
0809 18:46:51.034500 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:51.034502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:51.034574 (+ 72us) server_negotiation.cc:407] Connection header received
0809 18:46:51.034613 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:51.034614 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:51.034626 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:51.034707 (+ 81us) server_negotiation.cc:226] Negotiated authn=JWT
0809 18:46:51.034807 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:51.035554 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:51.036271 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:51.036626 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:51.036696 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:51.036845 (+ 149us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 18:46:51.037757 (+ 912us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38793/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 18:46:51.037899 (+ 142us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52628: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38793/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":36}
W20260809 18:46:51.038038 22010 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52628: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38793/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 18:46:51.039856 22060 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:46:51.034348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:39847 (local address 127.0.0.1:52628)
0809 18:46:51.034511 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:51.034520 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:51.034570 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:51.034705 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:51.034706 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:51.034707 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0809 18:46:51.034751 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:51.034752 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:51.035630 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:51.035630 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:51.036173 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:51.036174 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:51.036702 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:51.036703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:51.036747 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:51.036751 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 18:46:51.037871 (+ 1120us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38793/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 18:46:51.039759 (+ 1888us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.202.254:39847: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38793/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":1682,"thread_start_us":87,"threads_started":1}
I20260809 18:46:51.040045 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 21888
E20260809 18:46:51.067219 22062 webserver.cc:533] Webserver: sslize failed:
E20260809 18:46:51.067304 22062 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-09T18:46:51Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (230 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T18:46:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:46:51Z Disabled control of system clock
I20260809 18:46:51.105973 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:44691
--webserver_interface=127.12.202.254
--webserver_port=0
--builtin_ntp_servers=127.12.202.212:45157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:44691
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/testchainca.cert with env {}
W20260809 18:46:51.186754 22070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:51.186959 22070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:51.186981 22070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:51.188077 22070 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:46:51.188112 22070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:51.188126 22070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:51.188138 22070 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:46:51.188151 22070 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 18:46:51.188163 22070 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 18:46:51.188175 22070 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 18:46:51.189643 22070 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:45157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:44691
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:44691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:51.189888 22070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:51.190099 22070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:51.195087 22075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:51.195087 22081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:51.195114 22076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:51.195370 22070 server_base.cc:1034] running on GCE node
I20260809 18:46:51.195603 22070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:51.195923 22070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:51.197065 22070 hybrid_clock.cc:648] HybridClock initialized: now 1786301211197055 us; error 28 us; skew 500 ppm
I20260809 18:46:51.198387 22070 webserver.cc:460] Webserver started at http://127.12.202.254:36173/ using document root <none> and password file <none>
I20260809 18:46:51.198654 22070 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:51.198702 22070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:51.198875 22070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:51.199955 22070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "0604a3b723444aae909c05be077258d4"
format_stamp: "Formatted at 2026-08-09 18:46:51 on dist-test-slave-45dx"
server_key: "87a71abc9ce122dd51d72aa79cf0e5b0"
server_key_iv: "1748347f1d054e64fc88f9dc71bbf6d1"
server_key_version: "encryptionkey@0"
I20260809 18:46:51.200445 22070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "0604a3b723444aae909c05be077258d4"
format_stamp: "Formatted at 2026-08-09 18:46:51 on dist-test-slave-45dx"
server_key: "87a71abc9ce122dd51d72aa79cf0e5b0"
server_key_iv: "1748347f1d054e64fc88f9dc71bbf6d1"
server_key_version: "encryptionkey@0"
I20260809 18:46:51.201793 22070 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:51.202595 22088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:51.202805 22070 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:51.202905 22070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "0604a3b723444aae909c05be077258d4"
format_stamp: "Formatted at 2026-08-09 18:46:51 on dist-test-slave-45dx"
server_key: "87a71abc9ce122dd51d72aa79cf0e5b0"
server_key_iv: "1748347f1d054e64fc88f9dc71bbf6d1"
server_key_version: "encryptionkey@0"
I20260809 18:46:51.202976 22070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:51.224825 22070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:51.225184 22070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:51.225351 22070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:51.229571 22070 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:44691
I20260809 18:46:51.229635 22173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:44691 every 8 connection(s)
I20260809 18:46:51.229943 22070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:46:51.230542 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 22070
I20260809 18:46:51.230633 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:46:51.230865 13099 external_mini_cluster.cc:1428] Setting key ad8d3096b6cb08f77bfd008db6dacf9a
I20260809 18:46:51.231101 22177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:51.234720 22177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4: Bootstrap starting.
I20260809 18:46:51.235399 22177 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:51.235698 22177 log.cc:824] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:51.236579 22177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4: No bootstrap required, opened a new log
I20260809 18:46:51.237087 22181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:51.231488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52442 (local address 127.12.202.254:44691)
0809 18:46:51.231733 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:51.231742 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:51.231777 (+ 35us) server_negotiation.cc:407] Connection header received
0809 18:46:51.232444 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:51.232453 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:51.232535 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:51.232681 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:51.232876 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:51.234169 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:51.234936 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:51.235492 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:51.235629 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:51.236340 (+ 711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:51.236345 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:51.236345 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:46:51.236552 (+ 207us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:51.236594 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:46:51.236608 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:51.236719 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:51.236803 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 18:46:51.236876 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":107,"threads_started":1}
I20260809 18:46:51.238075 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:46:51.238817 22177 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0604a3b723444aae909c05be077258d4" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 44691 } }
I20260809 18:46:51.238983 22177 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:51.239032 22177 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0604a3b723444aae909c05be077258d4, State: Initialized, Role: FOLLOWER
I20260809 18:46:51.239156 22177 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0604a3b723444aae909c05be077258d4" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 44691 } }
I20260809 18:46:51.239240 22177 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:46:51.239281 22177 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:46:51.239333 22177 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:51.239862 22177 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0604a3b723444aae909c05be077258d4" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 44691 } }
I20260809 18:46:51.239981 22177 leader_election.cc:302] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0604a3b723444aae909c05be077258d4; no voters:
I20260809 18:46:51.240155 22177 leader_election.cc:288] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:46:51.240206 22186 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:51.240381 22186 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0604a3b723444aae909c05be077258d4, State: Running, Role: LEADER
I20260809 18:46:51.240419 22177 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:51.240470 22186 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0604a3b723444aae909c05be077258d4" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 44691 } }
I20260809 18:46:51.240845 22188 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0604a3b723444aae909c05be077258d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0604a3b723444aae909c05be077258d4" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 44691 } } }
I20260809 18:46:51.240955 22188 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4 [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:51.240824 22190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0604a3b723444aae909c05be077258d4. Latest consensus state: current_term: 1 leader_uuid: "0604a3b723444aae909c05be077258d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0604a3b723444aae909c05be077258d4" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 44691 } } }
I20260809 18:46:51.241040 22190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4 [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:51.241394 22203 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:46:51.241890 22203 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:46:51.243381 22203 catalog_manager.cc:1347] Generated new cluster ID: f6c744f580144effb129e6e6cbd699f2
I20260809 18:46:51.243436 22203 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:46:51.250203 22203 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:46:51.250890 22203 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:46:51.269752 22203 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0604a3b723444aae909c05be077258d4: Generated new TSK 0
I20260809 18:46:51.270004 22203 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:46:51.719889 22181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:51.279398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52450 (local address 127.12.202.254:44691)
0809 18:46:51.279469 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:51.279471 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:51.279550 (+ 79us) server_negotiation.cc:407] Connection header received
0809 18:46:51.279658 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:51.279659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:51.279669 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:51.279730 (+ 61us) server_negotiation.cc:226] Negotiated authn=JWT
0809 18:46:51.279888 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:51.280507 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:51.281646 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:51.281879 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:51.281936 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:51.282142 (+ 206us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 18:46:51.719581 (+437439us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 18:46:51.719794 (+ 213us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52450: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":26}
W20260809 18:46:51.719985 22181 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52450: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 18:46:51.720000 22232 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:46:51.279301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:44691 (local address 127.0.0.1:52450)
0809 18:46:51.279475 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:51.279486 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:51.279556 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:51.279747 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:51.279748 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:51.279750 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0809 18:46:51.279821 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:51.279824 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:51.280590 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:51.280591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:51.281548 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:51.281552 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:51.281971 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:51.281972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:51.282037 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:51.282044 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 18:46:51.719745 (+437701us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 18:46:51.719888 (+ 143us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.202.254:44691: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":106,"threads_started":1}
I20260809 18:46:51.720350 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 22070
2026-08-09T18:46:51Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (648 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (91 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (90 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:46:51 dist-test-slave-45dx krb5kdc[22247](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:46:51 dist-test-slave-45dx krb5kdc[22247](info): set up 2 sockets
Aug 09 18:46:51 dist-test-slave-45dx krb5kdc[22247](info): commencing operation
krb5kdc: starting...
W20260809 18:46:53.160022 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:46:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:46:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:46:53.284418 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:38891
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:44685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:38891
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:53.367599 22267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:53.367792 22267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:53.367815 22267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:53.369016 22267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:46:53.369058 22267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:53.369072 22267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:53.369086 22267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:46:53.369097 22267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:46:53.370478 22267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:44685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:38891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:38891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:53.370658 22267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:53.370814 22267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:53.375554 22283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:53.375617 22277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:53.375564 22279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:53.375730 22267 server_base.cc:1034] running on GCE node
I20260809 18:46:53.376070 22267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:53.376369 22267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:53.377523 22267 hybrid_clock.cc:648] HybridClock initialized: now 1786301213377502 us; error 38 us; skew 500 ppm
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:53.380080 22267 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:46:53.380559 22267 webserver.cc:460] Webserver started at http://127.12.202.254:40809/ using document root <none> and password file <none>
I20260809 18:46:53.380802 22267 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:53.380852 22267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:53.380995 22267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:53.382074 22267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "a12ac5517dbf42378cd6387811ec52fe"
format_stamp: "Formatted at 2026-08-09 18:46:53 on dist-test-slave-45dx"
server_key: "6c037d3cc6e944e2f896ba96d60c42b2"
server_key_iv: "b421a3a6087d321381aa729be7af1260"
server_key_version: "encryptionkey@0"
I20260809 18:46:53.382433 22267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "a12ac5517dbf42378cd6387811ec52fe"
format_stamp: "Formatted at 2026-08-09 18:46:53 on dist-test-slave-45dx"
server_key: "6c037d3cc6e944e2f896ba96d60c42b2"
server_key_iv: "b421a3a6087d321381aa729be7af1260"
server_key_version: "encryptionkey@0"
I20260809 18:46:53.383731 22267 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 18:46:53.384500 22292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:53.384675 22267 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:53.384769 22267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "a12ac5517dbf42378cd6387811ec52fe"
format_stamp: "Formatted at 2026-08-09 18:46:53 on dist-test-slave-45dx"
server_key: "6c037d3cc6e944e2f896ba96d60c42b2"
server_key_iv: "b421a3a6087d321381aa729be7af1260"
server_key_version: "encryptionkey@0"
I20260809 18:46:53.384869 22267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:53.396471 22267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:53.398238 22267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:53.398401 22267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:53.402772 22267 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:38891
I20260809 18:46:53.402828 22375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:38891 every 8 connection(s)
I20260809 18:46:53.403213 22267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:46:53.404093 22376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:53.406461 22376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe: Bootstrap starting.
I20260809 18:46:53.407080 22376 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:53.407385 22376 log.cc:824] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:53.408072 22376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe: No bootstrap required, opened a new log
I20260809 18:46:53.409742 22376 raft_consensus.cc:348] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12ac5517dbf42378cd6387811ec52fe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38891 } }
I20260809 18:46:53.409919 22376 raft_consensus.cc:374] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:53.409960 22376 raft_consensus.cc:729] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a12ac5517dbf42378cd6387811ec52fe, State: Initialized, Role: FOLLOWER
I20260809 18:46:53.410050 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 22267
I20260809 18:46:53.410156 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:46:53.410120 22376 consensus_queue.cc:260] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12ac5517dbf42378cd6387811ec52fe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38891 } }
I20260809 18:46:53.410199 22376 raft_consensus.cc:388] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:46:53.410231 22376 raft_consensus.cc:482] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:46:53.410313 22376 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:53.410378 13099 external_mini_cluster.cc:1428] Setting key 46295716ecc36ec8d2bc90bcfc266898
I20260809 18:46:53.411089 22376 raft_consensus.cc:504] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12ac5517dbf42378cd6387811ec52fe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38891 } }
I20260809 18:46:53.411229 22376 leader_election.cc:302] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a12ac5517dbf42378cd6387811ec52fe; no voters:
I20260809 18:46:53.411434 22376 leader_election.cc:288] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:46:53.411633 22382 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:53.411715 22376 sys_catalog.cc:564] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:53.411749 22382 raft_consensus.cc:686] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe [term 1 LEADER]: Becoming Leader. State: Replica: a12ac5517dbf42378cd6387811ec52fe, State: Running, Role: LEADER
I20260809 18:46:53.411835 22382 consensus_queue.cc:237] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12ac5517dbf42378cd6387811ec52fe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38891 } }
I20260809 18:46:53.412147 22382 sys_catalog.cc:455] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader a12ac5517dbf42378cd6387811ec52fe. Latest consensus state: current_term: 1 leader_uuid: "a12ac5517dbf42378cd6387811ec52fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12ac5517dbf42378cd6387811ec52fe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38891 } } }
I20260809 18:46:53.412160 22384 sys_catalog.cc:455] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a12ac5517dbf42378cd6387811ec52fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12ac5517dbf42378cd6387811ec52fe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38891 } } }
I20260809 18:46:53.412243 22382 sys_catalog.cc:458] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:53.412272 22384 sys_catalog.cc:458] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:53.412669 22391 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:46:53.413177 22391 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:46:53.415000 22391 catalog_manager.cc:1347] Generated new cluster ID: bf1875c1a018478aaa5667a833a3cde9
I20260809 18:46:53.415055 22391 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:53.421219 22380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:53.410949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47540 (local address 127.12.202.254:38891)
0809 18:46:53.411155 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:53.411165 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:53.411199 (+ 34us) server_negotiation.cc:407] Connection header received
0809 18:46:53.411327 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:53.411334 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:53.411407 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:53.411601 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:53.412602 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.414082 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.415162 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.415554 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.415671 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:53.418133 (+ 2462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:53.418136 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:53.418137 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:53.418149 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:53.419708 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:53.420062 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:53.420065 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:53.420065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:53.420169 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:53.420382 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:53.420383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:53.420384 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:53.420631 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:53.420824 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:53.420900 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 18:46:53.421041 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":156,"thread_start_us":127,"threads_started":1}
I20260809 18:46:53.440140 22391 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:46:53.440884 22391 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:46:53.455188 22391 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a12ac5517dbf42378cd6387811ec52fe: Generated new TSK 0
I20260809 18:46:53.455396 22391 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
I20260809 18:46:53.486570 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:38891
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:44685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:53.571844 22412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:53.572100 22412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:53.572137 22412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:53.573259 22412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:53.573331 22412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:53.573390 22412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:46:53.574873 22412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:44685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:38891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:53.575137 22412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:53.575366 22412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:53.580365 22418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:53.580348 22419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:53.580328 22421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:53.580653 22412 server_base.cc:1034] running on GCE node
I20260809 18:46:53.580868 22412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:53.581076 22412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:53.582226 22412 hybrid_clock.cc:648] HybridClock initialized: now 1786301213582224 us; error 36 us; skew 500 ppm
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:53.589449 22412 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:46:53.589892 22412 webserver.cc:460] Webserver started at http://127.12.202.193:36231/ using document root <none> and password file <none>
I20260809 18:46:53.590123 22412 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:53.590190 22412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:53.590342 22412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:53.591349 22412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "695ac3e5f8b74c87bbe3bed3b72f8de9"
format_stamp: "Formatted at 2026-08-09 18:46:53 on dist-test-slave-45dx"
server_key: "351f946b42cb756c3ac7ba978f435dc5"
server_key_iv: "b497bd88becf36921d985805caba3b8f"
server_key_version: "encryptionkey@0"
I20260809 18:46:53.591756 22412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "695ac3e5f8b74c87bbe3bed3b72f8de9"
format_stamp: "Formatted at 2026-08-09 18:46:53 on dist-test-slave-45dx"
server_key: "351f946b42cb756c3ac7ba978f435dc5"
server_key_iv: "b497bd88becf36921d985805caba3b8f"
server_key_version: "encryptionkey@0"
I20260809 18:46:53.593153 22412 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:46:53.593979 22436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:53.594178 22412 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:53.594290 22412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "695ac3e5f8b74c87bbe3bed3b72f8de9"
format_stamp: "Formatted at 2026-08-09 18:46:53 on dist-test-slave-45dx"
server_key: "351f946b42cb756c3ac7ba978f435dc5"
server_key_iv: "b497bd88becf36921d985805caba3b8f"
server_key_version: "encryptionkey@0"
I20260809 18:46:53.594365 22412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:53.606835 22412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:53.609208 22412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:53.609375 22412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:53.609616 22412 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:53.609908 22412 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:53.609963 22412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:53.610006 22412 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:53.610030 22412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:53.616225 22412 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:35789
I20260809 18:46:53.616283 22609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:35789 every 8 connection(s)
I20260809 18:46:53.616647 22412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:46:53.622653 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 22412
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:53.622771 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:46:53.622958 13099 external_mini_cluster.cc:1428] Setting key 1f35be4168e15f4610ed90bda56977ef
I20260809 18:46:53.626214 22380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:53.617452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:49229 (local address 127.12.202.254:38891)
0809 18:46:53.617522 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:53.617524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:53.617697 (+ 173us) server_negotiation.cc:407] Connection header received
0809 18:46:53.618652 (+ 955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:53.618653 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:53.618662 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:53.618720 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:53.619288 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.619763 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.620753 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.620939 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.620990 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:53.623353 (+ 2363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:53.623354 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:53.623355 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:53.623363 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:53.624780 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:53.625197 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:53.625198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:53.625199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:53.625276 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:53.625549 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:53.625550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:53.625551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:53.625665 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:53.625751 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:53.626040 (+ 289us) server_negotiation.cc:299] Negotiation successful
0809 18:46:53.626123 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 18:46:53.626398 22615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:53.617412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:38891 (local address 127.12.202.193:49229)
0809 18:46:53.617572 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:53.617613 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:53.618562 (+ 949us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:53.618773 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:53.618777 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:53.619033 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:53.619218 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:53.619222 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.619854 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.619855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:53.620683 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:53.620685 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.621011 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.621012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:53.621105 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:53.621543 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:53.621551 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:53.623251 (+ 1700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:53.624864 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:53.624879 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:53.624881 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:53.625104 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:53.625358 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:53.625358 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:53.625359 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:53.625477 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:53.625743 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:53.625750 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:53.625898 (+ 148us) client_negotiation.cc:769] Sending connection context
0809 18:46:53.626004 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 18:46:53.626163 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":89,"threads_started":1}
I20260809 18:46:53.626856 22611 heartbeater.cc:347] Connected to a master server at 127.12.202.254:38891
I20260809 18:46:53.626966 22611 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:53.627156 22611 heartbeater.cc:511] Master 127.12.202.254:38891 requested a full tablet report, sending...
I20260809 18:46:53.627694 22318 ts_manager.cc:194] Registered new tserver with Master: 695ac3e5f8b74c87bbe3bed3b72f8de9 (127.12.202.193:35789)
I20260809 18:46:53.628365 22318 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:49229
WARNING: no policy specified for kudu/127.12.202.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
I20260809 18:46:53.651630 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:38891
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:44685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:53.738785 22620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:53.738976 22620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:53.738999 22620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:53.740132 22620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:53.740175 22620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:53.740200 22620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:46:53.741786 22620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:44685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:38891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:53.742025 22620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:53.742242 22620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:53.747267 22627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:53.747275 22629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:53.747277 22626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:53.747717 22620 server_base.cc:1034] running on GCE node
I20260809 18:46:53.747957 22620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:53.748211 22620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:53.749403 22620 hybrid_clock.cc:648] HybridClock initialized: now 1786301213749380 us; error 33 us; skew 500 ppm
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:53.752022 22620 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:46:53.752517 22620 webserver.cc:460] Webserver started at http://127.12.202.194:40473/ using document root <none> and password file <none>
I20260809 18:46:53.752707 22620 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:53.752748 22620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:53.752848 22620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:53.753866 22620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "4dabc26f032742e993b18c3d2867038a"
format_stamp: "Formatted at 2026-08-09 18:46:53 on dist-test-slave-45dx"
server_key: "ba0b494bfbc0c7c4ae402ca5d6e42a10"
server_key_iv: "2f34c21a209568d49108a9301830766e"
server_key_version: "encryptionkey@0"
I20260809 18:46:53.754169 22620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "4dabc26f032742e993b18c3d2867038a"
format_stamp: "Formatted at 2026-08-09 18:46:53 on dist-test-slave-45dx"
server_key: "ba0b494bfbc0c7c4ae402ca5d6e42a10"
server_key_iv: "2f34c21a209568d49108a9301830766e"
server_key_version: "encryptionkey@0"
I20260809 18:46:53.755445 22620 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:46:53.756147 22645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:53.756318 22620 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:53.756415 22620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "4dabc26f032742e993b18c3d2867038a"
format_stamp: "Formatted at 2026-08-09 18:46:53 on dist-test-slave-45dx"
server_key: "ba0b494bfbc0c7c4ae402ca5d6e42a10"
server_key_iv: "2f34c21a209568d49108a9301830766e"
server_key_version: "encryptionkey@0"
I20260809 18:46:53.756474 22620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:53.773140 22620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:53.775187 22620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:53.775305 22620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:53.775527 22620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:53.775799 22620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:53.775830 22620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:53.775852 22620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:53.775864 22620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:53.781941 22620 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:38343
I20260809 18:46:53.782039 22821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:38343 every 8 connection(s)
I20260809 18:46:53.782343 22620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:46:53.787613 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 22620
I20260809 18:46:53.787739 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:46:53.787945 13099 external_mini_cluster.cc:1428] Setting key 90216361d1eaedee846a068ffcce003a
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:53.792245 22380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:53.783138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:50471 (local address 127.12.202.254:38891)
0809 18:46:53.783214 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:53.783216 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:53.783417 (+ 201us) server_negotiation.cc:407] Connection header received
0809 18:46:53.784390 (+ 973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:53.784391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:53.784403 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:53.784462 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:53.785070 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.785566 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.786524 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.786724 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.786780 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:53.789324 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:53.789326 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:53.789326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:53.789333 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:53.790749 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:53.791193 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:53.791194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:53.791194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:53.791259 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:53.791521 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:53.791522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:53.791522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:53.791655 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:53.791728 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:53.792023 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 18:46:53.792122 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 18:46:53.792477 22830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:53.783110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:38891 (local address 127.12.202.194:50471)
0809 18:46:53.783270 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:53.783312 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:53.784228 (+ 916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:53.784545 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:53.784548 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:53.784791 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:53.784994 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:53.784999 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.785648 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.785649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:53.786440 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:53.786442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.786801 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.786802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:53.786922 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:53.787430 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:53.787437 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:53.789200 (+ 1763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:53.790845 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:53.790852 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:53.790854 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:53.791102 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:53.791327 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:53.791328 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:53.791328 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:53.791448 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:53.791731 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:53.791739 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:53.791884 (+ 145us) client_negotiation.cc:769] Sending connection context
0809 18:46:53.791987 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 18:46:53.792147 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":89,"threads_started":1}
I20260809 18:46:53.793041 22823 heartbeater.cc:347] Connected to a master server at 127.12.202.254:38891
I20260809 18:46:53.793184 22823 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:53.793423 22823 heartbeater.cc:511] Master 127.12.202.254:38891 requested a full tablet report, sending...
I20260809 18:46:53.793841 22318 ts_manager.cc:194] Registered new tserver with Master: 4dabc26f032742e993b18c3d2867038a (127.12.202.194:38343)
I20260809 18:46:53.794231 22318 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:50471
WARNING: no policy specified for kudu/127.12.202.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
I20260809 18:46:53.815659 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:38891
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:44685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:53.896849 22835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:53.897096 22835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:53.897140 22835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:53.898526 22835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:53.898622 22835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:53.898674 22835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:46:53.900406 22835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:44685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:38891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:53.900667 22835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:53.900903 22835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:53.906133 22850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:53.906111 22846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:53.906172 22843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:53.906400 22835 server_base.cc:1034] running on GCE node
I20260809 18:46:53.906663 22835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:53.906915 22835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:53.908119 22835 hybrid_clock.cc:648] HybridClock initialized: now 1786301213908100 us; error 37 us; skew 500 ppm
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:53.910753 22835 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:46:53.911141 22835 webserver.cc:460] Webserver started at http://127.12.202.195:43643/ using document root <none> and password file <none>
I20260809 18:46:53.911342 22835 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:53.911384 22835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:53.911471 22835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:53.912664 22835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "ef6636e26e974ae7aca3de3f40fd9243"
format_stamp: "Formatted at 2026-08-09 18:46:53 on dist-test-slave-45dx"
server_key: "2dc3d771e0ca5320bb0b8409c48cbabf"
server_key_iv: "dd34b898f20e696687653014d537cfad"
server_key_version: "encryptionkey@0"
I20260809 18:46:53.913025 22835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "ef6636e26e974ae7aca3de3f40fd9243"
format_stamp: "Formatted at 2026-08-09 18:46:53 on dist-test-slave-45dx"
server_key: "2dc3d771e0ca5320bb0b8409c48cbabf"
server_key_iv: "dd34b898f20e696687653014d537cfad"
server_key_version: "encryptionkey@0"
I20260809 18:46:53.914328 22835 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:53.915007 22863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:53.915189 22835 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:53.915288 22835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "ef6636e26e974ae7aca3de3f40fd9243"
format_stamp: "Formatted at 2026-08-09 18:46:53 on dist-test-slave-45dx"
server_key: "2dc3d771e0ca5320bb0b8409c48cbabf"
server_key_iv: "dd34b898f20e696687653014d537cfad"
server_key_version: "encryptionkey@0"
I20260809 18:46:53.915364 22835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:53.925458 22835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:53.927315 22835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:53.927469 22835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:53.927675 22835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:53.927990 22835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:53.928023 22835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:53.928045 22835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:53.928138 22835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:53.934206 22835 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:40469
I20260809 18:46:53.934280 23046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:40469 every 8 connection(s)
I20260809 18:46:53.934572 22835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:46:53.940506 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 22835
I20260809 18:46:53.940632 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:46:53.940804 13099 external_mini_cluster.cc:1428] Setting key 07e9fd5bcae0790a9121ae23eea69095
I20260809 18:46:53.943755 22380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:53.935316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:57989 (local address 127.12.202.254:38891)
0809 18:46:53.935381 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:53.935384 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:53.935585 (+ 201us) server_negotiation.cc:407] Connection header received
0809 18:46:53.936530 (+ 945us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:53.936531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:53.936540 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:53.936595 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:53.937131 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.937581 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.938529 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.938714 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.938767 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:53.940819 (+ 2052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:53.940821 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:53.940821 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:53.940832 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:53.942369 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:53.942770 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:53.942771 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:53.942771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:53.942846 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:53.943116 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:53.943117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:53.943117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:53.943233 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:53.943301 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:53.943577 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 18:46:53.943659 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 18:46:53.943957 23049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:53.935292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:38891 (local address 127.12.202.195:57989)
0809 18:46:53.935460 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:53.935498 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:53.936446 (+ 948us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:53.936644 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:53.936647 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:53.936893 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:53.937058 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:53.937062 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.937657 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.937657 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:53.938453 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:53.938454 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.938802 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.938803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:53.938915 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:53.939357 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:53.939364 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:53.940725 (+ 1361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:53.942455 (+ 1730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:53.942462 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:53.942464 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:53.942692 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:53.942916 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:53.942916 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:53.942917 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:53.943043 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:53.943306 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:53.943312 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:53.943448 (+ 136us) client_negotiation.cc:769] Sending connection context
0809 18:46:53.943554 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 18:46:53.943729 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":99,"threads_started":1}
I20260809 18:46:53.944455 23047 heartbeater.cc:347] Connected to a master server at 127.12.202.254:38891
I20260809 18:46:53.944561 23047 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:53.944736 23047 heartbeater.cc:511] Master 127.12.202.254:38891 requested a full tablet report, sending...
I20260809 18:46:53.945119 22318 ts_manager.cc:194] Registered new tserver with Master: ef6636e26e974ae7aca3de3f40fd9243 (127.12.202.195:40469)
I20260809 18:46:53.945492 22318 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:57989
I20260809 18:46:53.952793 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/test-admin.keytab.
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:53.969856 13099 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 18:46:53.971925 23057 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:46:53.971106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41854 (local address 127.12.202.193:35789)
0809 18:46:53.971318 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:53.971323 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:53.971333 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:46:53.971359 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:53.971361 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:53.971374 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:53.971441 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:53.971811 (+ 370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41854: BlockingRecv error: recv got EOF from 127.0.0.1:41854 (error 108)
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":127,"threads_started":1}
W20260809 18:46:53.972041 13099 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/krb5cc' of type FILE
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:53.973081 13099 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:53.973968 13099 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.193@KRBTEST.COM
I20260809 18:46:53.981998 23057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:53.974473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41864 (local address 127.12.202.193:35789)
0809 18:46:53.974529 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:53.974531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:53.974540 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:46:53.974620 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:53.974621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:53.974632 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:53.974685 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:53.975085 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.975750 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.976480 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.976778 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.976853 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:53.978975 (+ 2122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:53.978983 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:53.978984 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:53.978991 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:53.980724 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:53.981136 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:53.981139 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:53.981139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:53.981200 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:53.981399 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:53.981400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:53.981400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:53.981527 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:53.981675 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:53.981798 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 18:46:53.981879 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260809 18:46:53.983605 23057 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:46:53.983177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41872 (local address 127.12.202.193:35789)
0809 18:46:53.983210 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:53.983211 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:53.983242 (+ 31us) server_negotiation.cc:407] Connection header received
0809 18:46:53.983278 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:53.983279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:53.983287 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:53.983333 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:53.983551 (+ 218us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41872: BlockingRecv error: recv got EOF from 127.0.0.1:41872 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 18:46:53.983780 13099 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/krb5cc' of type FILE
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:53.984673 13099 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:53.985453 13099 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.193@KRBTEST.COM
I20260809 18:46:53.991953 23057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:53.985897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41880 (local address 127.12.202.193:35789)
0809 18:46:53.985934 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:53.985935 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:53.985959 (+ 24us) server_negotiation.cc:407] Connection header received
0809 18:46:53.986002 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:53.986003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:53.986010 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:53.986053 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:53.986354 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.986768 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.987454 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.987631 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.987679 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:53.989624 (+ 1945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:53.989637 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:53.989637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:53.989643 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:53.990982 (+ 1339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:53.991307 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:53.991308 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:53.991308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:53.991357 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:53.991515 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:53.991515 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:53.991515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:53.991595 (+ 80us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:53.991660 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:53.991842 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 18:46:53.991900 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
W20260809 18:46:53.993427 23057 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:46:53.992891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41888 (local address 127.12.202.193:35789)
0809 18:46:53.992942 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:53.992943 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:53.992993 (+ 50us) server_negotiation.cc:407] Connection header received
0809 18:46:53.993057 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:53.993058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:53.993066 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:53.993113 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:53.993381 (+ 268us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41888: BlockingRecv error: recv got EOF from 127.0.0.1:41888 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260809 18:46:53.993656 13099 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786301184679835-13099-0/krb5kdc/krb5cc)
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:53.994545 13099 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:53.995378 13099 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 18:46:53 dist-test-slave-45dx krb5kdc[22247](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.193@KRBTEST.COM
I20260809 18:46:54.002170 23057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:53.995851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41894 (local address 127.12.202.193:35789)
0809 18:46:53.995908 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:53.995910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:53.995989 (+ 79us) server_negotiation.cc:407] Connection header received
0809 18:46:53.996049 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:53.996050 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:53.996059 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:53.996126 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:53.996568 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.997028 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.997687 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:53.997867 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:53.997967 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:53.999883 (+ 1916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:53.999884 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:53.999884 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:53.999890 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:54.001246 (+ 1356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:54.001550 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:54.001551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:54.001552 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:54.001607 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:54.001802 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:54.001802 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:54.001802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:54.001887 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:54.001954 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:54.002062 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 18:46:54.002115 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 18:46:54.002871 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 22412
I20260809 18:46:54.016952 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 22620
I20260809 18:46:54.031622 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 22835
I20260809 18:46:54.041043 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 22267
2026-08-09T18:46:54Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2138 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:46:54 dist-test-slave-45dx krb5kdc[23081](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:46:54 dist-test-slave-45dx krb5kdc[23081](info): set up 2 sockets
Aug 09 18:46:54 dist-test-slave-45dx krb5kdc[23081](info): commencing operation
krb5kdc: starting...
W20260809 18:46:55.301704 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:46:55 dist-test-slave-45dx krb5kdc[23081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301215, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:46:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:46:55Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.254.keytab.
Entry for principal oryx/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.254.keytab.
I20260809 18:46:55.422791 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:42525
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.254.keytab
--principal=oryx/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:42525
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:55.503784 23100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:55.504004 23100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:55.504041 23100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:55.505193 23100 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:46:55.505259 23100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:55.505281 23100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:55.505302 23100 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:46:55.505323 23100 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:46:55.506798 23100 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:42525
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.254.keytab
--principal=oryx/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:42525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:55.507050 23100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:55.507266 23100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:46:55.512265 23100 server_base.cc:1034] running on GCE node
W20260809 18:46:55.512246 23111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:55.512228 23113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:55.512215 23110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:55.512799 23100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:55.513095 23100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:55.514266 23100 hybrid_clock.cc:648] HybridClock initialized: now 1786301215514257 us; error 37 us; skew 500 ppm
Aug 09 18:46:55 dist-test-slave-45dx krb5kdc[23081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301215, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:55.517024 23100 init.cc:377] Logged in from keytab as oryx/127.12.202.254@KRBTEST.COM (short username oryx)
I20260809 18:46:55.517468 23100 webserver.cc:460] Webserver started at http://127.12.202.254:44805/ using document root <none> and password file <none>
I20260809 18:46:55.517715 23100 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:55.517783 23100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:55.517930 23100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:55.518998 23100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "38c653ab2b3049afbdfe338bd9aeddbe"
format_stamp: "Formatted at 2026-08-09 18:46:55 on dist-test-slave-45dx"
server_key: "e8dec53bd64abff99aca6e42631c375c"
server_key_iv: "2509c9e3235805749a5bfd8055e01f13"
server_key_version: "encryptionkey@0"
I20260809 18:46:55.519381 23100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "38c653ab2b3049afbdfe338bd9aeddbe"
format_stamp: "Formatted at 2026-08-09 18:46:55 on dist-test-slave-45dx"
server_key: "e8dec53bd64abff99aca6e42631c375c"
server_key_iv: "2509c9e3235805749a5bfd8055e01f13"
server_key_version: "encryptionkey@0"
I20260809 18:46:55.520709 23100 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 18:46:55.521411 23122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:55.521582 23100 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:55.521673 23100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "38c653ab2b3049afbdfe338bd9aeddbe"
format_stamp: "Formatted at 2026-08-09 18:46:55 on dist-test-slave-45dx"
server_key: "e8dec53bd64abff99aca6e42631c375c"
server_key_iv: "2509c9e3235805749a5bfd8055e01f13"
server_key_version: "encryptionkey@0"
I20260809 18:46:55.521757 23100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:55.560288 23100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:55.562806 23100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:55.562934 23100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:55.566955 23100 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:42525
I20260809 18:46:55.567020 23208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:42525 every 8 connection(s)
I20260809 18:46:55.567430 23100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:46:55.568156 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 23100
I20260809 18:46:55.568277 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:46:55.568506 13099 external_mini_cluster.cc:1428] Setting key c2f4ef11fc6095d3b0e0446849361d76
I20260809 18:46:55.568645 23209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:55.572232 23209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe: Bootstrap starting.
I20260809 18:46:55.572921 23209 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:55.573236 23209 log.cc:824] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:55.574030 23209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe: No bootstrap required, opened a new log
Aug 09 18:46:55 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301215, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM
I20260809 18:46:55.576766 23209 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } }
I20260809 18:46:55.576970 23209 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:55.577024 23209 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c653ab2b3049afbdfe338bd9aeddbe, State: Initialized, Role: FOLLOWER
I20260809 18:46:55.577162 23209 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } }
I20260809 18:46:55.577255 23209 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:46:55.577311 23209 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:46:55.577374 23209 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:55.578117 23209 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } }
I20260809 18:46:55.578228 23209 leader_election.cc:302] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38c653ab2b3049afbdfe338bd9aeddbe; no voters:
I20260809 18:46:55.578409 23209 leader_election.cc:288] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:46:55.578475 23217 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:55.578642 23217 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [term 1 LEADER]: Becoming Leader. State: Replica: 38c653ab2b3049afbdfe338bd9aeddbe, State: Running, Role: LEADER
I20260809 18:46:55.578689 23209 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:55.578733 23217 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } }
I20260809 18:46:55.579102 23217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38c653ab2b3049afbdfe338bd9aeddbe. Latest consensus state: current_term: 1 leader_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } }
I20260809 18:46:55.579195 23217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:55.579107 23219 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } }
I20260809 18:46:55.579447 23219 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:55.580837 23212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:55.569082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43634 (local address 127.12.202.254:42525)
0809 18:46:55.569302 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:55.569312 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:55.569348 (+ 36us) server_negotiation.cc:407] Connection header received
0809 18:46:55.569943 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:55.569952 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:55.570017 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:55.570176 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:55.570782 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:55.572135 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:55.572934 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:55.573528 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:55.573609 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:55.576472 (+ 2863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:55.576477 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:55.576477 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:55.576492 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:55.578619 (+ 2127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:55.579074 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:55.579077 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:55.579077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:55.579200 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:55.579458 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:55.579459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:55.579459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:55.579826 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:55.580507 (+ 681us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:55.580588 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 18:46:55.580688 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":101,"threads_started":1}
W20260809 18:46:55.580835 23242 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:46:55.580974 23242 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:46:55.581030 23225 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:46:55.581192 23225 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:46:55.582657 23225 catalog_manager.cc:1347] Generated new cluster ID: 0e284a8636d74fcdbced0c1349f03e63
I20260809 18:46:55.582720 23225 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:46:55.587375 23225 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:46:55.587863 23225 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:46:55.592267 23225 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe: Generated new TSK 0
I20260809 18:46:55.592459 23225 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.193.keytab.
Entry for principal oryx/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.193.keytab.
I20260809 18:46:55.630985 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42525
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.193.keytab
--principal=oryx/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:55.729113 23254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:55.729347 23254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:55.729386 23254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:55.730549 23254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:55.730619 23254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:55.730664 23254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:46:55.732133 23254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.193.keytab
--principal=oryx/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:55.732422 23254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:55.732654 23254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:46:55.737643 23254 server_base.cc:1034] running on GCE node
W20260809 18:46:55.737655 23261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:55.737627 23260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:55.737622 23265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:55.738018 23254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:55.738279 23254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:55.739431 23254 hybrid_clock.cc:648] HybridClock initialized: now 1786301215739423 us; error 32 us; skew 500 ppm
Aug 09 18:46:55 dist-test-slave-45dx krb5kdc[23081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301215, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:55.742027 23254 init.cc:377] Logged in from keytab as oryx/127.12.202.193@KRBTEST.COM (short username oryx)
I20260809 18:46:55.742479 23254 webserver.cc:460] Webserver started at http://127.12.202.193:41435/ using document root <none> and password file <none>
I20260809 18:46:55.742687 23254 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:55.742728 23254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:55.742816 23254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:55.743781 23254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "f439a24beb614ddf9e1111e805f09f7c"
format_stamp: "Formatted at 2026-08-09 18:46:55 on dist-test-slave-45dx"
server_key: "1394bb22e778bcd5a753a9d986da3cd3"
server_key_iv: "e8377a722051bc1a35c00cf9cc32e4e0"
server_key_version: "encryptionkey@0"
I20260809 18:46:55.744071 23254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "f439a24beb614ddf9e1111e805f09f7c"
format_stamp: "Formatted at 2026-08-09 18:46:55 on dist-test-slave-45dx"
server_key: "1394bb22e778bcd5a753a9d986da3cd3"
server_key_iv: "e8377a722051bc1a35c00cf9cc32e4e0"
server_key_version: "encryptionkey@0"
I20260809 18:46:55.745386 23254 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:46:55.746076 23278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:55.746389 23254 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:55.746498 23254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "f439a24beb614ddf9e1111e805f09f7c"
format_stamp: "Formatted at 2026-08-09 18:46:55 on dist-test-slave-45dx"
server_key: "1394bb22e778bcd5a753a9d986da3cd3"
server_key_iv: "e8377a722051bc1a35c00cf9cc32e4e0"
server_key_version: "encryptionkey@0"
I20260809 18:46:55.746574 23254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:55.757490 23254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:55.759802 23254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:55.759969 23254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:55.760195 23254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:55.760547 23254 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:55.760603 23254 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:55.760638 23254 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:55.760663 23254 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:55.766625 23254 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:46081
I20260809 18:46:55.766701 23448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:46081 every 8 connection(s)
I20260809 18:46:55.767030 23254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:46:55.767405 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 23254
I20260809 18:46:55.767524 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:46:55.767732 13099 external_mini_cluster.cc:1428] Setting key 39be9108cd5296ff8d7983f3acf016f9
Aug 09 18:46:55 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301215, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM
WARNING: no policy specified for oryx/127.12.202.194@KRBTEST.COM; defaulting to no policy
I20260809 18:46:55.777621 23212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:55.767864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:60029 (local address 127.12.202.254:42525)
0809 18:46:55.767938 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:55.767941 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:55.768161 (+ 220us) server_negotiation.cc:407] Connection header received
0809 18:46:55.768830 (+ 669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:55.768831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:55.768844 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:55.768914 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:55.769800 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:55.770519 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:55.772019 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:55.772218 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:55.772267 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:55.774721 (+ 2454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:55.774723 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:55.774723 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:55.774731 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:55.776168 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:55.776630 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:55.776631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:55.776632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:55.776697 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:55.776957 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:55.776958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:55.776958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:55.777072 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:55.777148 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:55.777447 (+ 299us) server_negotiation.cc:299] Negotiation successful
0809 18:46:55.777532 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 18:46:55.777798 23451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:55.767829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:60029)
0809 18:46:55.768037 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:55.768084 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:55.768723 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:55.768974 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:55.768977 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:55.769528 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:55.769708 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:55.769712 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:55.770622 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:55.770624 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:55.771938 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:55.771941 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:55.772319 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:55.772320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:55.772477 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:55.772966 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:55.772976 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:55.774616 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:55.776273 (+ 1657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:55.776280 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:55.776282 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:55.776550 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:55.776767 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:55.776768 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:55.776768 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:55.776883 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:55.777170 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:55.777177 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:55.777305 (+ 128us) client_negotiation.cc:769] Sending connection context
0809 18:46:55.777411 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 18:46:55.777564 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":121,"threads_started":1}
I20260809 18:46:55.778381 23449 heartbeater.cc:347] Connected to a master server at 127.12.202.254:42525
I20260809 18:46:55.778466 23449 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:55.778661 23449 heartbeater.cc:511] Master 127.12.202.254:42525 requested a full tablet report, sending...
I20260809 18:46:55.779316 23142 ts_manager.cc:194] Registered new tserver with Master: f439a24beb614ddf9e1111e805f09f7c (127.12.202.193:46081)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.202.194@KRBTEST.COM" created.
I20260809 18:46:55.780033 23142 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:60029
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.194.keytab.
Entry for principal oryx/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.194.keytab.
I20260809 18:46:55.795231 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42525
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.194.keytab
--principal=oryx/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:55.877832 23455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:55.878105 23455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:55.878135 23455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:55.879302 23455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:55.879340 23455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:55.879365 23455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:46:55.880990 23455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.194.keytab
--principal=oryx/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:55.881160 23455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:55.881326 23455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:55.886426 23467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:55.886451 23470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:55.886442 23466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:55.886478 23455 server_base.cc:1034] running on GCE node
I20260809 18:46:55.886888 23455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:55.887136 23455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:55.888339 23455 hybrid_clock.cc:648] HybridClock initialized: now 1786301215888334 us; error 38 us; skew 500 ppm
Aug 09 18:46:55 dist-test-slave-45dx krb5kdc[23081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301215, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:55.890859 23455 init.cc:377] Logged in from keytab as oryx/127.12.202.194@KRBTEST.COM (short username oryx)
I20260809 18:46:55.891307 23455 webserver.cc:460] Webserver started at http://127.12.202.194:40939/ using document root <none> and password file <none>
I20260809 18:46:55.891525 23455 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:55.891592 23455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:55.891743 23455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:55.892787 23455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "97c2d7a50f3440cf855f7410f086f40e"
format_stamp: "Formatted at 2026-08-09 18:46:55 on dist-test-slave-45dx"
server_key: "2a82008976f3ce8007f7696a3811231c"
server_key_iv: "15c7857a8cec06df9a0abcb075c4231e"
server_key_version: "encryptionkey@0"
I20260809 18:46:55.893146 23455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "97c2d7a50f3440cf855f7410f086f40e"
format_stamp: "Formatted at 2026-08-09 18:46:55 on dist-test-slave-45dx"
server_key: "2a82008976f3ce8007f7696a3811231c"
server_key_iv: "15c7857a8cec06df9a0abcb075c4231e"
server_key_version: "encryptionkey@0"
I20260809 18:46:55.894481 23455 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:46:55.895236 23486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:55.895426 23455 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:55.895529 23455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "97c2d7a50f3440cf855f7410f086f40e"
format_stamp: "Formatted at 2026-08-09 18:46:55 on dist-test-slave-45dx"
server_key: "2a82008976f3ce8007f7696a3811231c"
server_key_iv: "15c7857a8cec06df9a0abcb075c4231e"
server_key_version: "encryptionkey@0"
I20260809 18:46:55.895608 23455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:55.920275 23455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:55.922448 23455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:55.922626 23455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:55.922876 23455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:55.923202 23455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:55.923259 23455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:55.923300 23455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:55.923326 23455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:55.929620 23455 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:44151
I20260809 18:46:55.929669 23659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:44151 every 8 connection(s)
I20260809 18:46:55.930003 23455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:46:55.930488 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 23455
I20260809 18:46:55.930626 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:46:55.930799 13099 external_mini_cluster.cc:1428] Setting key 00a82aa35cd9e4aa2ddd4340123b0936
Aug 09 18:46:55 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301215, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM
WARNING: no policy specified for oryx/127.12.202.195@KRBTEST.COM; defaulting to no policy
I20260809 18:46:55.942371 23212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:55.931410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:47933 (local address 127.12.202.254:42525)
0809 18:46:55.931477 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:55.931480 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:55.931734 (+ 254us) server_negotiation.cc:407] Connection header received
0809 18:46:55.932585 (+ 851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:55.932586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:55.932597 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:55.932654 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:55.934014 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:55.934805 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:55.936379 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:55.936627 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:55.936700 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:55.939274 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:55.939275 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:55.939276 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:55.939292 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:55.940796 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:55.941371 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:55.941372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:55.941372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:55.941446 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:55.941722 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:55.941723 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:55.941723 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:55.941918 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:55.941992 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:55.942230 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 18:46:55.942302 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 18:46:55.942543 23666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:55.931407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:47933)
0809 18:46:55.931583 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:55.931628 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:55.932451 (+ 823us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:55.932724 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:55.932728 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:55.933625 (+ 897us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:55.933901 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:55.933907 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:55.934926 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:55.934927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:55.936261 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:55.936264 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:55.936733 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:55.936734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:55.936906 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:55.937455 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:55.937467 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:55.939171 (+ 1704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:55.940920 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:55.940927 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:55.940930 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:55.941245 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:55.941550 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:55.941551 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:55.941551 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:55.941653 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:55.941988 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:55.941994 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:55.942114 (+ 120us) client_negotiation.cc:769] Sending connection context
0809 18:46:55.942199 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 18:46:55.942324 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
I20260809 18:46:55.943228 23661 heartbeater.cc:347] Connected to a master server at 127.12.202.254:42525
I20260809 18:46:55.943352 23661 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:55.943578 23661 heartbeater.cc:511] Master 127.12.202.254:42525 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.202.195@KRBTEST.COM" created.
I20260809 18:46:55.944062 23142 ts_manager.cc:194] Registered new tserver with Master: 97c2d7a50f3440cf855f7410f086f40e (127.12.202.194:44151)
I20260809 18:46:55.944557 23142 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:47933
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.195.keytab.
Entry for principal oryx/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.195.keytab.
I20260809 18:46:55.959313 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42525
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.195.keytab
--principal=oryx/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:56.042855 23669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:56.043073 23669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:56.043097 23669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:56.044154 23669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:56.044188 23669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:56.044211 23669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:46:56.045629 23669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.195.keytab
--principal=oryx/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:56.045842 23669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:56.046020 23669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:56.051208 23676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:56.051218 23680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:56.051220 23675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:56.051458 23669 server_base.cc:1034] running on GCE node
I20260809 18:46:56.051769 23669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:56.052029 23669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:56.053200 23669 hybrid_clock.cc:648] HybridClock initialized: now 1786301216053187 us; error 42 us; skew 500 ppm
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:56.055876 23669 init.cc:377] Logged in from keytab as oryx/127.12.202.195@KRBTEST.COM (short username oryx)
I20260809 18:46:56.056337 23669 webserver.cc:460] Webserver started at http://127.12.202.195:37465/ using document root <none> and password file <none>
I20260809 18:46:56.056602 23669 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:56.056674 23669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:56.056824 23669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:56.057865 23669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "68ec9d0f9a134739813d3d6b8636e56e"
format_stamp: "Formatted at 2026-08-09 18:46:56 on dist-test-slave-45dx"
server_key: "ce7bfefafbf0e6968924d6d697dbbddc"
server_key_iv: "705e3a45a2cd43f3e229391b48140031"
server_key_version: "encryptionkey@0"
I20260809 18:46:56.058243 23669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "68ec9d0f9a134739813d3d6b8636e56e"
format_stamp: "Formatted at 2026-08-09 18:46:56 on dist-test-slave-45dx"
server_key: "ce7bfefafbf0e6968924d6d697dbbddc"
server_key_iv: "705e3a45a2cd43f3e229391b48140031"
server_key_version: "encryptionkey@0"
I20260809 18:46:56.059573 23669 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:46:56.060297 23700 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.060520 23669 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:56.060621 23669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "68ec9d0f9a134739813d3d6b8636e56e"
format_stamp: "Formatted at 2026-08-09 18:46:56 on dist-test-slave-45dx"
server_key: "ce7bfefafbf0e6968924d6d697dbbddc"
server_key_iv: "705e3a45a2cd43f3e229391b48140031"
server_key_version: "encryptionkey@0"
I20260809 18:46:56.060703 23669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:56.075903 23669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:56.078255 23669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:56.078421 23669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:56.078706 23669 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:56.079090 23669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:56.079147 23669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.079192 23669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:56.079218 23669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.085466 23669 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:36585
I20260809 18:46:56.085572 23875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:36585 every 8 connection(s)
I20260809 18:46:56.085850 23669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM
I20260809 18:46:56.094470 23212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.086553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:34363 (local address 127.12.202.254:42525)
0809 18:46:56.086631 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.086634 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.086797 (+ 163us) server_negotiation.cc:407] Connection header received
0809 18:46:56.087246 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.087247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.087257 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.087324 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.088214 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.088783 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.089738 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.089930 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.089981 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.091991 (+ 2010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.091993 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.091993 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.092000 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.093359 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.093718 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.093719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.093719 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.093767 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.093982 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.093982 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.093983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.094076 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.094123 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.094341 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.094407 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 18:46:56.094604 23878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.086517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:34363)
0809 18:46:56.086683 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.086717 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.087173 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.087401 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.087404 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.087955 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.088141 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.088146 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.088863 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.088864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.089663 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.089665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.090002 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.090003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.090104 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.090531 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.090539 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.091907 (+ 1368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.093435 (+ 1528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.093441 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.093443 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.093653 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.093822 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.093823 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.093823 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.093929 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.094127 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.094131 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.094232 (+ 101us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.094308 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.094420 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":94,"threads_started":1}
I20260809 18:46:56.094795 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 23669
I20260809 18:46:56.094882 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:46:56.095012 13099 external_mini_cluster.cc:1428] Setting key e451d4d0d1daccbca30efcfcbdf197f6
I20260809 18:46:56.095305 23876 heartbeater.cc:347] Connected to a master server at 127.12.202.254:42525
I20260809 18:46:56.095404 23876 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:56.095587 23876 heartbeater.cc:511] Master 127.12.202.254:42525 requested a full tablet report, sending...
I20260809 18:46:56.096037 23142 ts_manager.cc:194] Registered new tserver with Master: 68ec9d0f9a134739813d3d6b8636e56e (127.12.202.195:36585)
I20260809 18:46:56.096491 23142 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:34363
I20260809 18:46:56.107187 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.202.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.202.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.202.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.253.keytab.
Entry for principal oryx/127.12.202.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.253.keytab.
I20260809 18:46:56.132966 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.253:41855
--webserver_interface=127.12.202.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.253.keytab
--principal=oryx/127.12.202.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:42525,127.12.202.253:41855
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:56.215066 23883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:56.215267 23883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:56.215289 23883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:56.216444 23883 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:46:56.216483 23883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:56.216497 23883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:56.216511 23883 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:46:56.216567 23883 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:46:56.218053 23883 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:42525,127.12.202.253:41855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.253.keytab
--principal=oryx/127.12.202.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.253:41855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.202.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23883
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
W20260809 18:46:56.218194 23883 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.12.202.254:42525,127.12.202.253:41855'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 18:46:56.218348 23883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:56.218587 23883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:56.223578 23899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:56.223551 23890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:56.223594 23892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:56.223842 23883 server_base.cc:1034] running on GCE node
I20260809 18:46:56.224097 23883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:56.224404 23883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:56.225538 23883 hybrid_clock.cc:648] HybridClock initialized: now 1786301216225536 us; error 35 us; skew 500 ppm
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:56.228037 23883 init.cc:377] Logged in from keytab as oryx/127.12.202.253@KRBTEST.COM (short username oryx)
I20260809 18:46:56.228546 23883 webserver.cc:460] Webserver started at http://127.12.202.253:45057/ using document root <none> and password file <none>
I20260809 18:46:56.228796 23883 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:56.228870 23883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:56.229018 23883 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:56.230032 23883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/data/instance:
uuid: "28393c9c23b84c1593caa876aa7c6696"
format_stamp: "Formatted at 2026-08-09 18:46:56 on dist-test-slave-45dx"
server_key: "e55d22c282760aed0c49d34e4ef5146e"
server_key_iv: "2217f1d186c262981642d10a66721988"
server_key_version: "encryptionkey@0"
I20260809 18:46:56.230401 23883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/wal/instance:
uuid: "28393c9c23b84c1593caa876aa7c6696"
format_stamp: "Formatted at 2026-08-09 18:46:56 on dist-test-slave-45dx"
server_key: "e55d22c282760aed0c49d34e4ef5146e"
server_key_iv: "2217f1d186c262981642d10a66721988"
server_key_version: "encryptionkey@0"
I20260809 18:46:56.231668 23883 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:46:56.232404 23916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.232575 23883 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:56.232677 23883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/wal
uuid: "28393c9c23b84c1593caa876aa7c6696"
format_stamp: "Formatted at 2026-08-09 18:46:56 on dist-test-slave-45dx"
server_key: "e55d22c282760aed0c49d34e4ef5146e"
server_key_iv: "2217f1d186c262981642d10a66721988"
server_key_version: "encryptionkey@0"
I20260809 18:46:56.232757 23883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:56.252954 23883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:56.254837 23883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:56.255023 23883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:56.259260 23883 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.253:41855
I20260809 18:46:56.259292 24002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.253:41855 every 8 connection(s)
I20260809 18:46:56.259657 23883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/data/info.pb
I20260809 18:46:56.260852 24003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:56.263473 24003 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:46:56.267904 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 23883
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.253@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301215, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.202.253@KRBTEST.COM
I20260809 18:46:56.274560 23212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.264504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43646 (local address 127.12.202.254:42525)
0809 18:46:56.264568 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.264570 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.264997 (+ 427us) server_negotiation.cc:407] Connection header received
0809 18:46:56.265690 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.265692 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.265708 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.265773 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.266692 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.267186 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.268574 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.268790 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.268873 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.271449 (+ 2576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.271450 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.271450 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.271458 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.272956 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.273430 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.273431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.273432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.273494 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.273755 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.273757 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.273757 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.273969 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.274024 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.274352 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.274439 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:46:56.274662 24006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.264485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:43646)
0809 18:46:56.264680 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.264797 (+ 117us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.265563 (+ 766us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.265886 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.265890 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.266268 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.266591 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.266597 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.267286 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.267287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.268496 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.268500 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.268880 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.268881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.269018 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.269612 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.269622 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.271332 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.273051 (+ 1719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.273059 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.273061 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.273339 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.273569 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.273570 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.273570 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.273686 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.274042 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.274049 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.274204 (+ 155us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.274318 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.274463 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":111,"threads_started":1}
I20260809 18:46:56.275333 24003 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:46:56.277621 24008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.268422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37992 (local address 127.12.202.253:41855)
0809 18:46:56.268621 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.268626 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.268645 (+ 19us) server_negotiation.cc:407] Connection header received
0809 18:46:56.268718 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.268721 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.268741 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.268814 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.269546 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.270508 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.271392 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.271694 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.271777 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.274273 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.274279 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.274279 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.274304 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.276464 (+ 2160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.276767 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.276770 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.276770 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.276830 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.277073 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.277074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.277074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.277212 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.277402 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.277445 (+ 43us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.277516 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":117,"threads_started":1}
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.253@KRBTEST.COM for oryx/127.12.202.253@KRBTEST.COM
I20260809 18:46:56.282297 24006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.275593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:41855 (local address 127.0.0.1:37998)
0809 18:46:56.275644 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.275662 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.275706 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.275939 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.275939 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.276046 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.276085 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.276086 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.276905 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.276906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.277360 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.277361 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.277849 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.277850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.277909 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.278353 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.278357 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.279569 (+ 1212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.281490 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.281490 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.281491 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.281647 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.281846 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.281847 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.281847 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.281896 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.282095 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.282096 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.282127 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.282175 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.282242 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 18:46:56.282414 24010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.275667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37998 (local address 127.12.202.253:41855)
0809 18:46:56.275815 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.275818 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.275826 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:46:56.275845 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.275846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.275855 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.275929 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.276157 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.276834 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.277440 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.277740 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.277805 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.279651 (+ 1846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.279652 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.279652 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.279658 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.281421 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.281717 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.281718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.281718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.281779 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.281953 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.281954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.281954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.282043 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.282091 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.282189 (+ 98us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.282286 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":125,"thread_start_us":81,"threads_started":1}
I20260809 18:46:56.283630 24003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: Bootstrap starting.
I20260809 18:46:56.284215 24003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:56.284541 24003 log.cc:824] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:56.285225 24003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: No bootstrap required, opened a new log
I20260809 18:46:56.286515 24003 raft_consensus.cc:348] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } }
I20260809 18:46:56.286633 24003 raft_consensus.cc:374] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:56.286653 24003 raft_consensus.cc:729] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28393c9c23b84c1593caa876aa7c6696, State: Initialized, Role: FOLLOWER
I20260809 18:46:56.286794 24003 consensus_queue.cc:260] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } }
I20260809 18:46:56.287065 24013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } } }
I20260809 18:46:56.287145 24003 sys_catalog.cc:564] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:56.287160 24013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 18:46:56.288761 24039 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:46:56.288826 24039 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:46:56.290478 23883 master_runner.cc:428] Detected that this master 28393c9c23b84c1593caa876aa7c6696 is joining an existing cluster
I20260809 18:46:56.290567 23883 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.202.253:41855
I20260809 18:46:56.298559 23212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.291627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43658 (local address 127.12.202.254:42525)
0809 18:46:56.291674 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.291676 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.291828 (+ 152us) server_negotiation.cc:407] Connection header received
0809 18:46:56.291940 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.291941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.291953 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.292017 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.292533 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.293317 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.294029 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.294241 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.294318 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.295403 (+ 1085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.295404 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.295405 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.295414 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.297240 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.297603 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.297604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.297604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.297685 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.297939 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.297941 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.297941 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.298090 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.298167 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.298379 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.298464 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:46:56.298834 24046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.291596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:43658)
0809 18:46:56.291744 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.291762 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.291856 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.292031 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.292032 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.292322 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.292452 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.292454 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.293395 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.293396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.293921 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.293922 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.294343 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.294345 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.294408 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.294918 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.294922 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.295303 (+ 381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.297328 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.297329 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.297329 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.297523 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.297788 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.297789 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.297790 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.297854 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.298179 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.298180 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.298242 (+ 62us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.298339 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.298472 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":24,"thread_start_us":85,"threads_started":1}
I20260809 18:46:56.299608 24047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.291720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:41855 (local address 127.0.0.1:38008)
0809 18:46:56.291857 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.291867 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.291913 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.292076 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.292077 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.292319 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.292452 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.292454 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.294300 (+ 1846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.294301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.295135 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.295138 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.295605 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.295606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.295674 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.296148 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.296152 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.296563 (+ 411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.298577 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.298577 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.298578 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.298778 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.299024 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.299025 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.299025 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.299077 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.299331 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.299332 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.299369 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.299447 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.299537 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":17,"thread_start_us":77,"threads_started":1}
I20260809 18:46:56.299906 24010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.291639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38008 (local address 127.12.202.253:41855)
0809 18:46:56.291674 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.291676 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.291958 (+ 282us) server_negotiation.cc:407] Connection header received
0809 18:46:56.291973 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.291973 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.291981 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.292043 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.293428 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.294207 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.295240 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.295519 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.295602 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.296668 (+ 1066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.296669 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.296670 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.296676 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.298505 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.298914 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.298915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.298916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.298973 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.299144 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.299145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.299146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.299261 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.299345 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.299728 (+ 383us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.299803 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301215, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.254@KRBTEST.COM for oryx/127.12.202.253@KRBTEST.COM
I20260809 18:46:56.308591 24010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.301449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38018 (local address 127.12.202.253:41855)
0809 18:46:56.301488 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.301490 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.301626 (+ 136us) server_negotiation.cc:407] Connection header received
0809 18:46:56.301706 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.301707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.301715 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.301768 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.302260 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.302680 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.303745 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.303902 (+ 157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.303945 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.306040 (+ 2095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.306041 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.306041 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.306049 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.307394 (+ 1345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.307771 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.307772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.307772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.307832 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.308040 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.308041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.308041 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.308146 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.308219 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.308428 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.308505 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:46:56.308624 24048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.301372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:41855 (local address 127.0.0.1:38018)
0809 18:46:56.301512 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.301556 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.301633 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.301773 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.301777 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.302124 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.302179 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.302181 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.302756 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.302757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.303663 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.303665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.303969 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.303970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.304052 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.304516 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.304521 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.305916 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.307481 (+ 1565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.307489 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.307491 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.307693 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.307902 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.307903 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.307903 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.307970 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.308213 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.308220 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.308272 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.308400 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.308513 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":88,"threads_started":1}
I20260809 18:46:56.309294 23142 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.202.253:41855: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "28393c9c23b84c1593caa876aa7c6696"
member_type: NON_VOTER
last_known_addr {
host: "127.12.202.253"
port: 41855
}
attrs {
promote: true
}
}
dest_uuid: "38c653ab2b3049afbdfe338bd9aeddbe"
cas_config_opid_index: -1
I20260809 18:46:56.309680 23142 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } }
I20260809 18:46:56.310246 24050 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 28393c9c23b84c1593caa876aa7c6696 (127.12.202.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } } }
I20260809 18:46:56.310477 23962 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:56.311245 23962 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Refusing update from remote peer 38c653ab2b3049afbdfe338bd9aeddbe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 18:46:56.311290 24050 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.202.253:41855
I20260809 18:46:56.311586 23883 master.cc:537] Master@127.12.202.253:41855 shutting down...
I20260809 18:46:56.311673 24050 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [LEADER]: Connected to new peer: Peer: permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:56.312129 24049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } } }
I20260809 18:46:56.312206 24049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [sys.catalog]: This master's current role is: LEADER
W20260809 18:46:56.312393 23126 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260809 18:46:56.312883 23126 consensus_peers.cc:487] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe -> Peer 28393c9c23b84c1593caa876aa7c6696 (127.12.202.253:41855): Couldn't send request to peer 28393c9c23b84c1593caa876aa7c6696. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 18:46:56.314680 23883 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:46:56.314772 23883 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:56.314826 23883 tablet_replica.cc:330] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: stopping tablet replica
I20260809 18:46:56.327482 23883 master.cc:552] Master@127.12.202.253:41855 shutdown complete.
I20260809 18:46:56.327538 23883 master_runner.cc:305] Clearing existing system tablet
I20260809 18:46:56.327688 23883 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:56.327739 23883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:56.328545 23883 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:46:56.329144 24056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.329289 23883 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:56.329360 23883 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.329387 23883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/wal
uuid: "28393c9c23b84c1593caa876aa7c6696"
format_stamp: "Formatted at 2026-08-09 18:46:56 on dist-test-slave-45dx"
server_key: "e55d22c282760aed0c49d34e4ef5146e"
server_key_iv: "2217f1d186c262981642d10a66721988"
server_key_version: "encryptionkey@0"
I20260809 18:46:56.330212 23883 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:56.331670 23883 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 18:46:56.331753 23883 log.cc:1196] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 18:46:56.332015 23883 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: Deleting consensus metadata
I20260809 18:46:56.332157 23883 master_runner.cc:315] Copying system tablet from 127.12.202.254:42525
I20260809 18:46:56.332777 23883 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: tablet copy: Beginning tablet copy session from remote peer at address 127.12.202.254:42525
I20260809 18:46:56.339154 24069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.333069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:43664)
0809 18:46:56.333202 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.333211 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.333270 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.333424 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.333425 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.333577 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.333633 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.333635 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.334563 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.334564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.335114 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.335115 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.335583 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.335584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.335631 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.336124 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.336128 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.336509 (+ 381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.338235 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.338236 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.338236 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.338409 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.338609 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.338609 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.338609 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.338661 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.338925 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.338925 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.338960 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.339008 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.339081 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":82,"threads_started":1}
I20260809 18:46:56.339205 23212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.333152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43664 (local address 127.12.202.254:42525)
0809 18:46:56.333216 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.333218 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.333262 (+ 44us) server_negotiation.cc:407] Connection header received
0809 18:46:56.333333 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.333334 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.333345 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.333402 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.333704 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.334475 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.335196 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.335507 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.335580 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.336593 (+ 1013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.336595 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.336595 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.336604 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.338146 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.338477 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.338478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.338479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.338543 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.338722 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.338723 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.338723 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.338855 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.338931 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.339035 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.339112 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 18:46:56.339510 23182 tablet_copy_service.cc:140] P 38c653ab2b3049afbdfe338bd9aeddbe: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 28393c9c23b84c1593caa876aa7c6696 ({username='oryx', principal='oryx/127.12.202.253@KRBTEST.COM'} at 127.0.0.1:43664)
I20260809 18:46:56.339641 23182 tablet_copy_service.cc:161] P 38c653ab2b3049afbdfe338bd9aeddbe: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 28393c9c23b84c1593caa876aa7c6696 at {username='oryx', principal='oryx/127.12.202.253@KRBTEST.COM'} at 127.0.0.1:43664: session id = 28393c9c23b84c1593caa876aa7c6696-00000000000000000000000000000000
I20260809 18:46:56.340689 23182 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 18:46:56.341320 23883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 18:46:56.342654 23883 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: tablet copy: Starting download of 0 data blocks...
I20260809 18:46:56.342805 23883 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: tablet copy: Starting download of 1 WAL segments...
I20260809 18:46:56.343714 23883 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 18:46:56.344527 23182 tablet_copy_service.cc:342] P 38c653ab2b3049afbdfe338bd9aeddbe: Request end of tablet copy session 28393c9c23b84c1593caa876aa7c6696-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.202.253@KRBTEST.COM'} at 127.0.0.1:43664
I20260809 18:46:56.344588 23182 tablet_copy_service.cc:433] P 38c653ab2b3049afbdfe338bd9aeddbe: ending tablet copy session 28393c9c23b84c1593caa876aa7c6696-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 28393c9c23b84c1593caa876aa7c6696
I20260809 18:46:56.346941 23883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:56.348026 24070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:56.348124 24075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:56.348232 23883 server_base.cc:1034] running on GCE node
W20260809 18:46:56.348340 24071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:56.348483 23883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:56.348651 23883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:56.349773 23883 hybrid_clock.cc:648] HybridClock initialized: now 1786301216349763 us; error 28 us; skew 500 ppm
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:56.351320 23883 init.cc:377] Logged in from keytab as oryx/127.12.202.253@KRBTEST.COM (short username oryx)
I20260809 18:46:56.351617 23883 webserver.cc:460] Webserver started at http://127.12.202.253:33005/ using document root <none> and password file <none>
I20260809 18:46:56.351743 23883 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:56.351799 23883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:56.352429 23883 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.352967 24090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.353163 23883 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.353210 23883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/wal
uuid: "28393c9c23b84c1593caa876aa7c6696"
format_stamp: "Formatted at 2026-08-09 18:46:56 on dist-test-slave-45dx"
server_key: "e55d22c282760aed0c49d34e4ef5146e"
server_key_iv: "2217f1d186c262981642d10a66721988"
server_key_version: "encryptionkey@0"
I20260809 18:46:56.353266 23883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:56.365144 23883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:56.366714 23883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:56.369318 23883 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.253:41855
I20260809 18:46:56.369566 24178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.253:41855 every 8 connection(s)
I20260809 18:46:56.369730 23883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-1/data/info.pb
I20260809 18:46:56.370575 24179 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:46:56.371089 24179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: Bootstrap starting.
I20260809 18:46:56.374040 24179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:46:56.374297 24179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: Bootstrap complete.
I20260809 18:46:56.374532 24179 raft_consensus.cc:348] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } }
I20260809 18:46:56.374629 24179 raft_consensus.cc:729] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 28393c9c23b84c1593caa876aa7c6696, State: Initialized, Role: LEARNER
I20260809 18:46:56.374670 24179 consensus_queue.cc:260] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } }
I20260809 18:46:56.374846 24179 sys_catalog.cc:564] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:56.374854 24183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } } }
I20260809 18:46:56.375001 24183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [sys.catalog]: This master's current role is: LEARNER
I20260809 18:46:56.376428 24200 catalog_manager.cc:1259] Loaded cluster ID: 0e284a8636d74fcdbced0c1349f03e63
I20260809 18:46:56.376521 24200 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: loading cluster ID for follower catalog manager: success
I20260809 18:46:56.377410 24200 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: acquiring CA information for follower catalog manager: success
I20260809 18:46:56.377682 24200 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 18:46:56.385867 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.379166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38032 (local address 127.12.202.253:41855)
0809 18:46:56.379310 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.379312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.379320 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:46:56.379358 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.379358 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.379368 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.379462 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.380172 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.380879 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.381584 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.381804 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.381888 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.383158 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.383160 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.383161 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.383168 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.384719 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.385068 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.385069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.385070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.385131 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.385340 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.385341 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.385341 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.385448 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.385554 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.385663 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.385750 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":55,"threads_started":1}
WARNING: no policy specified for oryx/127.12.202.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.202.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.202.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.252.keytab.
Entry for principal oryx/127.12.202.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.252.keytab.
I20260809 18:46:56.413504 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.252:35433
--webserver_interface=127.12.202.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.252.keytab
--principal=oryx/127.12.202.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:42525,127.12.202.253:41855,127.12.202.252:35433
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:46:56.511760 24206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:56.511960 24206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:56.511981 24206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:56.513217 24206 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:46:56.513260 24206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:56.513275 24206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:56.513288 24206 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:46:56.513304 24206 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:46:56.514823 24206 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:42525,127.12.202.253:41855,127.12.202.252:35433
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.252.keytab
--principal=oryx/127.12.202.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.252:35433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.202.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:56.515061 24206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:56.515282 24206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:56.520445 24214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:56.520397 24220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:56.520432 24213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:56.520598 24206 server_base.cc:1034] running on GCE node
I20260809 18:46:56.520844 24206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:56.521127 24206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:56.522280 24206 hybrid_clock.cc:648] HybridClock initialized: now 1786301216522266 us; error 30 us; skew 500 ppm
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:56.524842 24206 init.cc:377] Logged in from keytab as oryx/127.12.202.252@KRBTEST.COM (short username oryx)
I20260809 18:46:56.525286 24206 webserver.cc:460] Webserver started at http://127.12.202.252:43845/ using document root <none> and password file <none>
I20260809 18:46:56.525552 24206 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:56.525599 24206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:56.525754 24206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:46:56.526945 24206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/data/instance:
uuid: "ea851c3bc0544c89b0f7e86930b7e1a5"
format_stamp: "Formatted at 2026-08-09 18:46:56 on dist-test-slave-45dx"
server_key: "540a39051a510b7ca3432846f9747596"
server_key_iv: "aafd72df37602701bcb86450d83ef8e2"
server_key_version: "encryptionkey@0"
I20260809 18:46:56.527351 24206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/wal/instance:
uuid: "ea851c3bc0544c89b0f7e86930b7e1a5"
format_stamp: "Formatted at 2026-08-09 18:46:56 on dist-test-slave-45dx"
server_key: "540a39051a510b7ca3432846f9747596"
server_key_iv: "aafd72df37602701bcb86450d83ef8e2"
server_key_version: "encryptionkey@0"
I20260809 18:46:56.528875 24206 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:46:56.529712 24237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.529932 24206 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:46:56.530002 24206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/wal
uuid: "ea851c3bc0544c89b0f7e86930b7e1a5"
format_stamp: "Formatted at 2026-08-09 18:46:56 on dist-test-slave-45dx"
server_key: "540a39051a510b7ca3432846f9747596"
server_key_iv: "aafd72df37602701bcb86450d83ef8e2"
server_key_version: "encryptionkey@0"
I20260809 18:46:56.530095 24206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:56.537209 24206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:56.539037 24206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:56.539197 24206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:56.546738 24206 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.252:35433
I20260809 18:46:56.546846 24324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.252:35433 every 8 connection(s)
I20260809 18:46:56.547200 24206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/data/info.pb
I20260809 18:46:56.548524 24325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:56.549880 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 24206
I20260809 18:46:56.551129 24325 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301215, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.202.252@KRBTEST.COM
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.252@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM
I20260809 18:46:56.562032 23212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.552449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43676 (local address 127.12.202.254:42525)
0809 18:46:56.552508 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.552510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.552518 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:46:56.552544 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.552545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.552557 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.552615 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.553280 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.553866 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.555214 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.555575 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.555648 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.559172 (+ 3524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.559173 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.559174 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.559180 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.560736 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.561122 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.561123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.561124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.561187 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.561426 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.561427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.561427 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.561546 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.561617 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.561847 (+ 230us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.561938 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 18:46:56.562291 24330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.551953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:43676)
0809 18:46:56.552164 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.552203 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.552267 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.552696 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.552698 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.552992 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.553172 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.553178 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.554058 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.554060 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.555108 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.555110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.555786 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.555788 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.555896 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.556598 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.556609 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.559103 (+ 2494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.560814 (+ 1711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.560820 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.560821 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.561018 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.561255 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.561256 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.561256 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.561348 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.561620 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.561627 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.561696 (+ 69us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.561820 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.561983 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":125,"threads_started":1}
I20260809 18:46:56.562309 24329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.550612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50748 (local address 127.12.202.252:35433)
0809 18:46:56.550810 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.550817 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.550854 (+ 37us) server_negotiation.cc:407] Connection header received
0809 18:46:56.551294 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.551300 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.551342 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.551514 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.552470 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.553630 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.554632 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.555183 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.555273 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.558574 (+ 3301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.558581 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.558581 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.558587 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.560775 (+ 2188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.561129 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.561132 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.561132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.561224 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.561430 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.561431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.561431 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.561627 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.561813 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.561887 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.562083 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":92,"server-negotiator.queue_time_us":153,"thread_start_us":79,"threads_started":1}
I20260809 18:46:56.562995 24325 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.252@KRBTEST.COM for oryx/127.12.202.253@KRBTEST.COM
I20260809 18:46:56.569659 24330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.563235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:41855 (local address 127.0.0.1:38046)
0809 18:46:56.563283 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.563292 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.563326 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.563489 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.563489 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.563619 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.563698 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.563699 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.564509 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.564510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.565003 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.565004 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.565406 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.565407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.565505 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.565824 (+ 319us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.565827 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.566948 (+ 1121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.568618 (+ 1670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.568619 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.568619 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.568788 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.569014 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.569014 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.569015 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.569072 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.569327 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.569328 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.569380 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.569466 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.569556 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 18:46:56.569671 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.563311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38046 (local address 127.12.202.253:41855)
0809 18:46:56.563367 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.563369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.563378 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:46:56.563404 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.563405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.563417 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.563488 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.563780 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.564429 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.565087 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.565316 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.565405 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.567037 (+ 1632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.567038 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.567039 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.567046 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.568523 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.568883 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.568884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.568885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.568946 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.569146 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.569147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.569147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.569261 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.569342 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.569493 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.569570 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 18:46:56.570271 24325 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35433 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.252@KRBTEST.COM for oryx/127.12.202.252@KRBTEST.COM
I20260809 18:46:56.576459 24329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.570604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50758 (local address 127.12.202.252:35433)
0809 18:46:56.570633 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.570635 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.570643 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:46:56.570684 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.570685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.570693 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.570746 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.570973 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.571471 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.572116 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.572412 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.572495 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.573943 (+ 1448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.573944 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.573944 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.573950 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.575417 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.575695 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.575695 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.575696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.575744 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.575985 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.575985 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.575985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.576076 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.576123 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.576224 (+ 101us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.576387 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":15}
I20260809 18:46:56.576509 24330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.570532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35433 (local address 127.0.0.1:50758)
0809 18:46:56.570580 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.570590 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.570633 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.570750 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.570750 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.570880 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.570900 (+ 20us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.570901 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.571555 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.571556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.572029 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.572031 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.572497 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.572498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.572547 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.572874 (+ 327us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.572878 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.573872 (+ 994us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.575480 (+ 1608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.575481 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.575481 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.575632 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.575881 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.575882 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.575882 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.575941 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.576129 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.576130 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.576158 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.576201 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.576270 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 18:46:56.577873 24325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: Bootstrap starting.
I20260809 18:46:56.579186 24325 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:56.579778 24325 log.cc:824] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:56.580792 24325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: No bootstrap required, opened a new log
I20260809 18:46:56.583030 24325 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35433 } }
I20260809 18:46:56.583148 24325 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:56.583169 24325 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea851c3bc0544c89b0f7e86930b7e1a5, State: Initialized, Role: FOLLOWER
I20260809 18:46:56.583326 24325 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35433 } }
I20260809 18:46:56.583675 24325 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:56.583667 24332 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35433 } } }
I20260809 18:46:56.583766 24332 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 18:46:56.586067 24351 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:46:56.586143 24351 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:46:56.588225 24206 master_runner.cc:428] Detected that this master ea851c3bc0544c89b0f7e86930b7e1a5 is joining an existing cluster
I20260809 18:46:56.588284 24206 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.202.252:35433
I20260809 18:46:56.596680 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.589569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38062 (local address 127.12.202.253:41855)
0809 18:46:56.589610 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.589612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.590322 (+ 710us) server_negotiation.cc:407] Connection header received
0809 18:46:56.590398 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.590399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.590409 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.590454 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.590916 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.591690 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.592767 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.592974 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.593060 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.594042 (+ 982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.594044 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.594044 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.594052 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.595505 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.595849 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.595850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.595850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.595911 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.596130 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.596131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.596132 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.596233 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.596303 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.596510 (+ 207us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.596582 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 18:46:56.596971 24363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.589617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:41855 (local address 127.0.0.1:38062)
0809 18:46:56.590244 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.590254 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.590332 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.590467 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.590467 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.590709 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.590781 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.590783 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.591785 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.591786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.592689 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.592691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.593104 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.593105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.593167 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.593658 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.593663 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.593953 (+ 290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.595594 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.595595 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.595595 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.595775 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.595980 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.595981 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.595981 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.596059 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.596333 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.596334 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.596383 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.596466 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.596584 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":146,"threads_started":1}
I20260809 18:46:56.602391 24363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.590044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35433 (local address 127.0.0.1:50774)
0809 18:46:56.597063 (+ 7019us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.597075 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.597215 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.597380 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.597381 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.597537 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.597608 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.597610 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.598181 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.598182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.598834 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.598836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.599188 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.599190 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.599247 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.599662 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.599666 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.599907 (+ 241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.601340 (+ 1433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.601340 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.601341 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.601502 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.601718 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.601719 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.601719 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.601787 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.602054 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.602055 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.602093 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.602161 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.602255 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7005,"thread_start_us":139,"threads_started":1}
I20260809 18:46:56.602398 24329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.589989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50774 (local address 127.12.202.252:35433)
0809 18:46:56.590035 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.590037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.597126 (+ 7089us) server_negotiation.cc:407] Connection header received
0809 18:46:56.597284 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.597285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.597294 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.597371 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.597676 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.598100 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.598929 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.599108 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.599201 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.600004 (+ 803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.600005 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.600005 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.600011 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.601247 (+ 1236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.601584 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.601585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.601585 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.601637 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.601855 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.601856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.601856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.601983 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.602063 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.602191 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.602304 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":26}
I20260809 18:46:56.613868 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 23254
I20260809 18:46:56.616650 23212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.590098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43684 (local address 127.12.202.254:42525)
0809 18:46:56.590135 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.590137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.590145 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:46:56.590167 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.590168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.590178 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.590235 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.590862 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.591362 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.592626 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.592976 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.593049 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.613279 (+ 20230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.613280 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.613280 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.613289 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.615444 (+ 2155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.615825 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.615826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.615826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.615883 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.616069 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.616070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.616071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.616196 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.616238 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.616472 (+ 234us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.616557 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 18:46:56.616974 24359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.589486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:43684)
0809 18:46:56.589964 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.589976 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.590025 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.590296 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.590298 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.590635 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.590764 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.590766 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.591454 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.591455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.592533 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.592535 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.593107 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.593108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.593175 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.612755 (+ 19580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.612761 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.613153 (+ 392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.615538 (+ 2385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.615539 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.615540 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.615743 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.615952 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.615953 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.615953 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.616004 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.616283 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.616284 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.616356 (+ 72us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.616768 (+ 412us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.616872 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":514,"threads_started":1}
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301215, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.254@KRBTEST.COM for oryx/127.12.202.252@KRBTEST.COM
I20260809 18:46:56.627718 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:46081
--local_ip_for_outbound_sockets=127.12.202.193
--tserver_master_addrs=127.12.202.254:42525
--webserver_port=41435
--webserver_interface=127.12.202.193
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.193.keytab
--principal=oryx/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.202.254:42525,127.12.202.253:41855
--tserver_master_addrs=127.12.202.254:42525,127.12.202.253:41855,127.12.202.252:35433 with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:46:56.630134 24329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.622205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50786 (local address 127.12.202.252:35433)
0809 18:46:56.622270 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.622272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.622282 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:46:56.622319 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.622320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.622330 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.622394 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.622738 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.623475 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.624594 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.624925 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.625002 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.627369 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.627370 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.627371 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.627379 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.628853 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.629235 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.629237 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.629237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.629305 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.629534 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.629535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.629536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.629682 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.629725 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.629961 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.630041 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 18:46:56.630151 24048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.619154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35433 (local address 127.0.0.1:50786)
0809 18:46:56.619249 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.619264 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.619316 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.622428 (+ 3112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.622429 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.622598 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.622649 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.622650 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.623584 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.623585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.624504 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.624507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.625018 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.625019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.625095 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.625554 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.625559 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.627280 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.628958 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.628959 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.628960 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.629138 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.629403 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.629404 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.629404 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.629467 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.629774 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.629774 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.629822 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.629905 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.630020 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 18:46:56.630659 23142 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.202.252:35433: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5"
member_type: NON_VOTER
last_known_addr {
host: "127.12.202.252"
port: 35433
}
attrs {
promote: true
}
}
dest_uuid: "38c653ab2b3049afbdfe338bd9aeddbe"
cas_config_opid_index: 5
I20260809 18:46:56.630918 23142 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } }
I20260809 18:46:56.631283 24051 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER ea851c3bc0544c89b0f7e86930b7e1a5 (127.12.202.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } } }
I20260809 18:46:56.632514 24281 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:56.633634 24281 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [term 1 FOLLOWER]: Refusing update from remote peer 38c653ab2b3049afbdfe338bd9aeddbe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 18:46:56.633930 24049 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:56.634691 24051 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.202.252:35433
I20260809 18:46:56.634774 24051 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } } }
I20260809 18:46:56.634848 24051 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:56.635142 24206 master.cc:537] Master@127.12.202.252:35433 shutting down...
I20260809 18:46:56.635776 24048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.631367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:41855 (local address 127.0.0.1:38066)
0809 18:46:56.631613 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.631623 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.631661 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.631863 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.631863 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.631864 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:56.631899 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.631900 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.632828 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.632829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.634525 (+ 1696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.634529 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.635511 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.635512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.635584 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.635610 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.635664 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.635704 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232}
I20260809 18:46:56.635982 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.631459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38066 (local address 127.12.202.253:41855)
0809 18:46:56.631585 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.631587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.631707 (+ 120us) server_negotiation.cc:407] Connection header received
0809 18:46:56.631732 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.631733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.631756 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.631807 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:56.631969 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.632738 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.634638 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.635320 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.635397 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.635473 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.635872 (+ 399us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.635916 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260809 18:46:56.636677 24134 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 LEARNER]: Refusing update from remote peer 38c653ab2b3049afbdfe338bd9aeddbe: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 18:46:56.637387 24049 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [LEADER]: Connected to new peer: Peer: permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 18:46:56.637634 24281 raft_consensus.cc:858] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35433 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } }
W20260809 18:46:56.637712 24281 raft_consensus.cc:1565] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35433 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } }
I20260809 18:46:56.637954 24134 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER ea851c3bc0544c89b0f7e86930b7e1a5 (127.12.202.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } } }
I20260809 18:46:56.638182 24281 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 28393c9c23b84c1593caa876aa7c6696 (127.12.202.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } } }
I20260809 18:46:56.639420 24183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38c653ab2b3049afbdfe338bd9aeddbe. Latest consensus state: current_term: 1 leader_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } } }
I20260809 18:46:56.639441 24332 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38c653ab2b3049afbdfe338bd9aeddbe. Latest consensus state: current_term: 1 leader_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } } }
I20260809 18:46:56.639521 24332 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260809 18:46:56.639520 24183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [sys.catalog]: This master's current role is: LEARNER
I20260809 18:46:56.639568 24183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } } }
I20260809 18:46:56.639560 24332 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } } }
I20260809 18:46:56.639609 24183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [sys.catalog]: This master's current role is: LEARNER
I20260809 18:46:56.639626 24332 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260809 18:46:56.639657 24332 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: NON_VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: true } } }
I20260809 18:46:56.639691 24332 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260809 18:46:56.639963 24049 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe: attempting to promote NON_VOTER 28393c9c23b84c1593caa876aa7c6696 to VOTER
I20260809 18:46:56.640156 24049 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: false } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } }
I20260809 18:46:56.641300 24134 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 LEARNER]: Refusing update from remote peer 38c653ab2b3049afbdfe338bd9aeddbe: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 18:46:56.641544 24051 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [LEADER]: Connected to new peer: Peer: permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260809 18:46:56.642010 24206 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260809 18:46:56.642103 24206 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
W20260809 18:46:56.642086 23126 consensus_peers.cc:487] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe -> Peer ea851c3bc0544c89b0f7e86930b7e1a5 (127.12.202.252:35433): Couldn't send request to peer ea851c3bc0544c89b0f7e86930b7e1a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 18:46:56.642141 24206 tablet_replica.cc:330] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: stopping tablet replica
I20260809 18:46:56.642251 24050 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 28393c9c23b84c1593caa876aa7c6696 (127.12.202.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: false } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } } }
I20260809 18:46:56.643296 24050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: false } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } } }
I20260809 18:46:56.643397 24050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:56.643332 24051 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: false } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } } }
I20260809 18:46:56.643488 24051 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe [sys.catalog]: This master's current role is: LEADER
I20260809 18:46:56.643592 24134 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 28393c9c23b84c1593caa876aa7c6696 (127.12.202.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: false } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } } }
I20260809 18:46:56.644678 24374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: false } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } } }
I20260809 18:46:56.644801 24374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:46:56.659675 24206 master.cc:552] Master@127.12.202.252:35433 shutdown complete.
I20260809 18:46:56.659729 24206 master_runner.cc:305] Clearing existing system tablet
I20260809 18:46:56.659858 24206 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:56.659906 24206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:56.660660 24206 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:46:56.661341 24385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.661490 24206 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:56.661557 24206 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:46:56.661584 24206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/wal
uuid: "ea851c3bc0544c89b0f7e86930b7e1a5"
format_stamp: "Formatted at 2026-08-09 18:46:56 on dist-test-slave-45dx"
server_key: "540a39051a510b7ca3432846f9747596"
server_key_iv: "aafd72df37602701bcb86450d83ef8e2"
server_key_version: "encryptionkey@0"
I20260809 18:46:56.662372 24206 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:56.663920 24206 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 18:46:56.663996 24206 log.cc:1196] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 18:46:56.664249 24206 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: Deleting consensus metadata
I20260809 18:46:56.664448 24206 master_runner.cc:315] Copying system tablet from 127.12.202.254:42525
I20260809 18:46:56.665081 24206 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: tablet copy: Beginning tablet copy session from remote peer at address 127.12.202.254:42525
I20260809 18:46:56.673043 24392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.665386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:43700)
0809 18:46:56.665504 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.665515 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.665574 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.665732 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.665733 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.665935 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.666008 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.666010 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.667083 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.667084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.667936 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.667939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.668582 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.668583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.668657 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.669245 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.669251 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.669657 (+ 406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.671767 (+ 2110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.671768 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.671768 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.671998 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.672242 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.672242 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.672243 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.672325 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.672723 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.672724 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.672772 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.672845 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.672946 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":65,"threads_started":1}
I20260809 18:46:56.673090 23212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.665457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43700 (local address 127.12.202.254:42525)
0809 18:46:56.665506 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.665508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.665562 (+ 54us) server_negotiation.cc:407] Connection header received
0809 18:46:56.665629 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.665630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.665640 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.665717 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.666105 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.666981 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.668033 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.668491 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.668570 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.669791 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.669793 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.669793 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.669802 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.671671 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.672087 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.672089 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.672089 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.672159 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.672439 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.672440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.672440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.672588 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.672669 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.672898 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.672991 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:46:56.673714 23182 tablet_copy_service.cc:140] P 38c653ab2b3049afbdfe338bd9aeddbe: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer ea851c3bc0544c89b0f7e86930b7e1a5 ({username='oryx', principal='oryx/127.12.202.252@KRBTEST.COM'} at 127.0.0.1:43700)
I20260809 18:46:56.673799 23182 tablet_copy_service.cc:161] P 38c653ab2b3049afbdfe338bd9aeddbe: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer ea851c3bc0544c89b0f7e86930b7e1a5 at {username='oryx', principal='oryx/127.12.202.252@KRBTEST.COM'} at 127.0.0.1:43700: session id = ea851c3bc0544c89b0f7e86930b7e1a5-00000000000000000000000000000000
I20260809 18:46:56.674466 23182 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 18:46:56.674988 24206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 18:46:56.676668 24206 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: tablet copy: Starting download of 0 data blocks...
I20260809 18:46:56.676846 24206 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: tablet copy: Starting download of 1 WAL segments...
I20260809 18:46:56.677556 24206 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 18:46:56.678504 23182 tablet_copy_service.cc:342] P 38c653ab2b3049afbdfe338bd9aeddbe: Request end of tablet copy session ea851c3bc0544c89b0f7e86930b7e1a5-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.202.252@KRBTEST.COM'} at 127.0.0.1:43700
I20260809 18:46:56.678588 23182 tablet_copy_service.cc:433] P 38c653ab2b3049afbdfe338bd9aeddbe: ending tablet copy session ea851c3bc0544c89b0f7e86930b7e1a5-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer ea851c3bc0544c89b0f7e86930b7e1a5
I20260809 18:46:56.681838 24206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:56.683085 24398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:56.683137 24394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:56.683470 24206 server_base.cc:1034] running on GCE node
W20260809 18:46:56.683663 24393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:56.683807 24206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:56.683966 24206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:56.685123 24206 hybrid_clock.cc:648] HybridClock initialized: now 1786301216685104 us; error 39 us; skew 500 ppm
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:56.686594 24206 init.cc:377] Logged in from keytab as oryx/127.12.202.252@KRBTEST.COM (short username oryx)
I20260809 18:46:56.686880 24206 webserver.cc:460] Webserver started at http://127.12.202.252:46523/ using document root <none> and password file <none>
I20260809 18:46:56.687001 24206 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:56.687037 24206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:56.687664 24206 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.688249 24408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.688406 24206 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.688454 24206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/wal
uuid: "ea851c3bc0544c89b0f7e86930b7e1a5"
format_stamp: "Formatted at 2026-08-09 18:46:56 on dist-test-slave-45dx"
server_key: "540a39051a510b7ca3432846f9747596"
server_key_iv: "aafd72df37602701bcb86450d83ef8e2"
server_key_version: "encryptionkey@0"
I20260809 18:46:56.688516 24206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:56.694398 24206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:56.696172 24206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:56.699425 24206 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.252:35433
I20260809 18:46:56.699621 24507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.252:35433 every 8 connection(s)
I20260809 18:46:56.699790 24206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/master-2/data/info.pb
I20260809 18:46:56.700678 24508 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:46:56.701114 24508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: Bootstrap starting.
I20260809 18:46:56.702941 24508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:46:56.703245 24508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: Bootstrap complete.
I20260809 18:46:56.703447 24508 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: false } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } }
I20260809 18:46:56.703537 24508 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ea851c3bc0544c89b0f7e86930b7e1a5, State: Initialized, Role: LEARNER
I20260809 18:46:56.703583 24508 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: false } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } }
I20260809 18:46:56.703788 24508 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:46:56.703768 24512 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: false } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } } }
I20260809 18:46:56.703977 24512 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5 [sys.catalog]: This master's current role is: LEARNER
I20260809 18:46:56.705281 24532 catalog_manager.cc:1259] Loaded cluster ID: 0e284a8636d74fcdbced0c1349f03e63
I20260809 18:46:56.705457 24532 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: loading cluster ID for follower catalog manager: success
I20260809 18:46:56.706434 24532 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: acquiring CA information for follower catalog manager: success
I20260809 18:46:56.706714 24532 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ea851c3bc0544c89b0f7e86930b7e1a5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 18:46:56.742869 24364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:56.743160 24364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:56.743206 24364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:56.744884 24364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:56.744947 24364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:56.744993 24364 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:46:56.747123 24364 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.193.keytab
--principal=oryx/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:46081
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=41435
--tserver_master_addrs=127.12.202.254:42525,127.12.202.253:41855,127.12.202.252:35433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:56.747360 24364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:56.747622 24364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:56.753156 24542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:56.753219 24541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:56.753389 24544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:56.753767 24364 server_base.cc:1034] running on GCE node
I20260809 18:46:56.754068 24364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:56.754356 24364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:56.755527 24364 hybrid_clock.cc:648] HybridClock initialized: now 1786301216755514 us; error 33 us; skew 500 ppm
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:56.758459 24364 init.cc:377] Logged in from keytab as oryx/127.12.202.193@KRBTEST.COM (short username oryx)
I20260809 18:46:56.758958 24364 webserver.cc:460] Webserver started at http://127.12.202.193:41435/ using document root <none> and password file <none>
I20260809 18:46:56.759189 24364 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:56.759276 24364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:56.760756 24364 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 18:46:56.761493 24553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.761673 24364 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:46:56.761807 24364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "f439a24beb614ddf9e1111e805f09f7c"
format_stamp: "Formatted at 2026-08-09 18:46:55 on dist-test-slave-45dx"
server_key: "1394bb22e778bcd5a753a9d986da3cd3"
server_key_iv: "e8377a722051bc1a35c00cf9cc32e4e0"
server_key_version: "encryptionkey@0"
I20260809 18:46:56.762221 24364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:56.776991 24364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:56.779711 24364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:56.779961 24364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:56.780380 24364 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:56.780807 24364 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:56.780843 24364 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.780867 24364 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:56.780912 24364 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.793109 24364 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:46081
I20260809 18:46:56.793223 24732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:46081 every 8 connection(s)
I20260809 18:46:56.793576 24364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:46:56.794360 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 24364
I20260809 18:46:56.794580 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 23455
I20260809 18:46:56.808239 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:44151
--local_ip_for_outbound_sockets=127.12.202.194
--tserver_master_addrs=127.12.202.254:42525
--webserver_port=40939
--webserver_interface=127.12.202.194
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.194.keytab
--principal=oryx/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.202.254:42525,127.12.202.253:41855
--tserver_master_addrs=127.12.202.254:42525,127.12.202.253:41855,127.12.202.252:35433 with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.253@KRBTEST.COM
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.252@KRBTEST.COM
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM
I20260809 18:46:56.813508 23212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.794888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:44477 (local address 127.12.202.254:42525)
0809 18:46:56.794949 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.794952 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.801878 (+ 6926us) server_negotiation.cc:407] Connection header received
0809 18:46:56.801996 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.801998 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.802013 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.802050 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.803227 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.803990 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.805713 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.806030 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.806070 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.810062 (+ 3992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.810063 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.810064 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.810072 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.811896 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.812335 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.812337 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.812337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.812403 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.812691 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.812692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.812692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.812828 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.812903 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.813301 (+ 398us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.813407 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 18:46:56.813673 24743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.794435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:44477)
0809 18:46:56.801794 (+ 7359us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.801807 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.801912 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.802234 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.802238 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.802768 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.803107 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.803114 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.804123 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.804124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.805612 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.805615 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.806151 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.806152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.806265 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.806982 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.806992 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.809950 (+ 2958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.811995 (+ 2045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.812003 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.812005 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.812231 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.812478 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.812479 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.812479 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.812612 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.812928 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.812935 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.813106 (+ 171us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.813261 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.813431 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7334,"mutex_wait_us":80,"thread_start_us":231,"threads_started":1}
I20260809 18:46:56.813910 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.795145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:34185 (local address 127.12.202.253:41855)
0809 18:46:56.795193 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.795195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.802123 (+ 6928us) server_negotiation.cc:407] Connection header received
0809 18:46:56.802223 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.802224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.802237 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.802266 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.803222 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.804023 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.805713 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.806008 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.806051 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.810856 (+ 4805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.810857 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.810857 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.810875 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.812553 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.812928 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.812929 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.812929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.812993 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.813237 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.813238 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.813238 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.813389 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.813447 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.813672 (+ 225us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.813759 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:46:56.814182 24734 heartbeater.cc:347] Connected to a master server at 127.12.202.254:42525
I20260809 18:46:56.814270 24741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.794888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:41855 (local address 127.12.202.193:34185)
0809 18:46:56.802053 (+ 7165us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.802065 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.802153 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.802332 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.802333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.802750 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.803107 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.803112 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.804208 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.804208 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.805610 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.805612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.806131 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.806132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.806264 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.807127 (+ 863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.807131 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.810748 (+ 3617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.812632 (+ 1884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.812633 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.812634 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.812833 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.813073 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.813074 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.813075 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.813142 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.813487 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.813488 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.813546 (+ 58us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.813996 (+ 450us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.814104 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7140,"mutex_wait_us":146,"thread_start_us":103,"threads_started":1}
I20260809 18:46:56.814294 24734 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:56.814592 24734 heartbeater.cc:511] Master 127.12.202.254:42525 requested a full tablet report, sending...
I20260809 18:46:56.814983 24737 heartbeater.cc:347] Connected to a master server at 127.12.202.253:41855
I20260809 18:46:56.814985 23142 ts_manager.cc:194] Re-registered known tserver with Master: f439a24beb614ddf9e1111e805f09f7c (127.12.202.193:46081)
I20260809 18:46:56.815028 24737 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:56.815085 24737 heartbeater.cc:511] Master 127.12.202.253:41855 requested a full tablet report, sending...
I20260809 18:46:56.815358 24744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.794420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35433 (local address 127.12.202.193:33753)
0809 18:46:56.795393 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.795459 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.797290 (+ 1831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.802825 (+ 5535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.802826 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.802977 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.803106 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.803112 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.804310 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.804311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.805609 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.805612 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.806124 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.806125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.806264 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.807022 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.807028 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.809477 (+ 2449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.814078 (+ 4601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.814079 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.814080 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.814271 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.814613 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.814614 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.814614 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.814678 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.814997 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.814998 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.815044 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.815104 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.815210 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":879,"mutex_wait_us":124,"thread_start_us":214,"threads_started":1}
I20260809 18:46:56.815419 24120 ts_manager.cc:194] Registered new tserver with Master: f439a24beb614ddf9e1111e805f09f7c (127.12.202.193:46081)
I20260809 18:46:56.815448 23142 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:44477
I20260809 18:46:56.815732 24745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.795116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:33753 (local address 127.12.202.252:35433)
0809 18:46:56.802649 (+ 7533us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.802651 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.802660 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:46:56.802685 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.802685 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.802698 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.802771 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.803214 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.804229 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.805704 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.806009 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.806064 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.809588 (+ 3524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.809589 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.809589 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.809597 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.811433 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.814368 (+ 2935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.814370 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.814370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.814461 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.814734 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.814735 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.814736 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.814901 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.814966 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.815496 (+ 530us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.815596 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7509,"thread_start_us":57,"threads_started":1}
I20260809 18:46:56.816160 24733 heartbeater.cc:347] Connected to a master server at 127.12.202.252:35433
I20260809 18:46:56.816215 24733 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:56.816279 24733 heartbeater.cc:511] Master 127.12.202.252:35433 requested a full tablet report, sending...
I20260809 18:46:56.816809 24438 ts_manager.cc:194] Registered new tserver with Master: f439a24beb614ddf9e1111e805f09f7c (127.12.202.193:46081)
W20260809 18:46:56.896075 24746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:56.896265 24746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:56.896288 24746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:56.897475 24746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:56.897521 24746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:56.897547 24746 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:46:56.898972 24746 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.194.keytab
--principal=oryx/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:44151
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=40939
--tserver_master_addrs=127.12.202.254:42525,127.12.202.253:41855,127.12.202.252:35433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:56.899156 24746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:56.899333 24746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:56.904469 24752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:56.904497 24760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:56.904584 24746 server_base.cc:1034] running on GCE node
W20260809 18:46:56.904520 24753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:56.904896 24746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:56.905114 24746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:56.906252 24746 hybrid_clock.cc:648] HybridClock initialized: now 1786301216906231 us; error 36 us; skew 500 ppm
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:56.908704 24746 init.cc:377] Logged in from keytab as oryx/127.12.202.194@KRBTEST.COM (short username oryx)
I20260809 18:46:56.909158 24746 webserver.cc:460] Webserver started at http://127.12.202.194:40939/ using document root <none> and password file <none>
I20260809 18:46:56.909364 24746 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:56.909418 24746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:56.910964 24746 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:46:56.911525 24773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.911705 24746 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.911795 24746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "97c2d7a50f3440cf855f7410f086f40e"
format_stamp: "Formatted at 2026-08-09 18:46:55 on dist-test-slave-45dx"
server_key: "2a82008976f3ce8007f7696a3811231c"
server_key_iv: "15c7857a8cec06df9a0abcb075c4231e"
server_key_version: "encryptionkey@0"
I20260809 18:46:56.912106 24746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:56.926667 24746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:56.929296 24746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:56.929425 24746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:56.929627 24746 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:56.929977 24746 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:56.930016 24746 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.930042 24746 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:56.930091 24746 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:56.936190 24746 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:44151
I20260809 18:46:56.936277 24964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:44151 every 8 connection(s)
I20260809 18:46:56.936655 24746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.253@KRBTEST.COM
I20260809 18:46:56.944998 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 24746
I20260809 18:46:56.945165 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 23669
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.252@KRBTEST.COM
Aug 09 18:46:56 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301216, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM
I20260809 18:46:56.949395 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.937489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:46953 (local address 127.12.202.253:41855)
0809 18:46:56.937544 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.937547 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.938283 (+ 736us) server_negotiation.cc:407] Connection header received
0809 18:46:56.939258 (+ 975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.939260 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.939272 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.939307 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.940289 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.941049 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.942257 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.942495 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.942575 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.946311 (+ 3736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.946313 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.946313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.946321 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.947861 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.948388 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.948389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.948389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.948447 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.948683 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.948684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.948684 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.948811 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.948849 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.949157 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.949239 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 18:46:56.950062 24971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.937496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:41855 (local address 127.12.202.194:46953)
0809 18:46:56.938191 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.938200 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.939159 (+ 959us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.939482 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.939483 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.939946 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.940202 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.940212 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.941129 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.941130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.942151 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.942154 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.942643 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.942644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.942838 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.943444 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.943454 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.946208 (+ 2754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.947965 (+ 1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.947973 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.947975 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.948273 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.948510 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.948511 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.948511 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.948626 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.948889 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.948894 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.949035 (+ 141us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.949704 (+ 669us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.949872 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"mutex_wait_us":152,"thread_start_us":177,"threads_started":1}
I20260809 18:46:56.962757 24968 heartbeater.cc:347] Connected to a master server at 127.12.202.253:41855
I20260809 18:46:56.962888 24968 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:56.963119 24968 heartbeater.cc:511] Master 127.12.202.253:41855 requested a full tablet report, sending...
I20260809 18:46:56.963661 24120 ts_manager.cc:194] Registered new tserver with Master: 97c2d7a50f3440cf855f7410f086f40e (127.12.202.194:44151)
I20260809 18:46:56.966286 24745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.938012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:34809 (local address 127.12.202.252:35433)
0809 18:46:56.938070 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.938072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.938257 (+ 185us) server_negotiation.cc:407] Connection header received
0809 18:46:56.939258 (+ 1001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.939259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.939275 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.939307 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.940365 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.940844 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.942452 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.942765 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.942846 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.963156 (+ 20310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.963159 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.963159 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.963168 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.964948 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.965365 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.965367 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.965367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.965438 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.965670 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.965671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.965672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.965820 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.965891 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.966099 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.966200 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:46:56.966286 24974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.937893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35433 (local address 127.12.202.194:34809)
0809 18:46:56.938188 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.938200 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.939156 (+ 956us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.939482 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.939483 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.939902 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.940224 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.940225 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.941023 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.941024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.942342 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.942345 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.942865 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.942866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.942986 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.943595 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.943600 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.963032 (+ 19432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.965066 (+ 2034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.965067 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.965067 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.965268 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.965541 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.965542 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.965542 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.965605 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.965919 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.965920 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.965977 (+ 57us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.966060 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.966180 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":68,"thread_start_us":112,"threads_started":1}
I20260809 18:46:56.966849 23212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.937613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:40635 (local address 127.12.202.254:42525)
0809 18:46:56.937666 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:56.937668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:56.937958 (+ 290us) server_negotiation.cc:407] Connection header received
0809 18:46:56.939250 (+ 1292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:56.939252 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:56.939265 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:56.939349 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:56.940231 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.941053 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.942533 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.942841 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.942909 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.963027 (+ 20118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:56.963029 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:56.963029 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:56.963039 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:56.965195 (+ 2156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.965601 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.965602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.965603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.965678 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:56.965928 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:56.965929 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:56.965929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:56.966096 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:56.966168 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:56.966614 (+ 446us) server_negotiation.cc:299] Negotiation successful
0809 18:46:56.966710 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 18:46:56.967438 24970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:56.937496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:40635)
0809 18:46:56.937808 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:56.937845 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:56.939134 (+ 1289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:56.939431 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:56.939434 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:56.939857 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:56.940128 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.940133 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.941366 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.941367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.942409 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:56.942412 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:56.942987 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:56.942988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:56.943155 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:56.943834 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:56.943839 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:56.962796 (+ 18957us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:56.965281 (+ 2485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.965282 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.965283 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.965527 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.965751 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:56.965751 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:56.965751 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:56.965803 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:56.966199 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:56.966200 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:56.966247 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 18:46:56.966985 (+ 738us) client_negotiation.cc:240] Negotiation successful
0809 18:46:56.967103 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":2,"thread_start_us":166,"threads_started":1}
I20260809 18:46:56.967983 24966 heartbeater.cc:347] Connected to a master server at 127.12.202.252:35433
I20260809 18:46:56.968041 24966 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:56.968122 24966 heartbeater.cc:511] Master 127.12.202.252:35433 requested a full tablet report, sending...
I20260809 18:46:56.968127 24967 heartbeater.cc:347] Connected to a master server at 127.12.202.254:42525
I20260809 18:46:56.968210 24967 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:56.968288 24967 heartbeater.cc:511] Master 127.12.202.254:42525 requested a full tablet report, sending...
I20260809 18:46:56.968482 24438 ts_manager.cc:194] Registered new tserver with Master: 97c2d7a50f3440cf855f7410f086f40e (127.12.202.194:44151)
I20260809 18:46:56.968641 23142 ts_manager.cc:194] Re-registered known tserver with Master: 97c2d7a50f3440cf855f7410f086f40e (127.12.202.194:44151)
I20260809 18:46:56.968969 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:36585
--local_ip_for_outbound_sockets=127.12.202.195
--tserver_master_addrs=127.12.202.254:42525
--webserver_port=37465
--webserver_interface=127.12.202.195
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.195.keytab
--principal=oryx/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.202.254:42525,127.12.202.253:41855
--tserver_master_addrs=127.12.202.254:42525,127.12.202.253:41855,127.12.202.252:35433 with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:46:56.969172 23142 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:40635
W20260809 18:46:57.060781 24978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:46:57.060988 24978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:46:57.061012 24978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:46:57.062296 24978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:46:57.062357 24978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:46:57.062405 24978 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:46:57.064018 24978 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.195.keytab
--principal=oryx/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:36585
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=37465
--tserver_master_addrs=127.12.202.254:42525,127.12.202.253:41855,127.12.202.252:35433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:46:57.064213 24978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:46:57.064452 24978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:46:57.069942 24983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:46:57.069948 24984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:57.070017 24978 server_base.cc:1034] running on GCE node
W20260809 18:46:57.069962 24987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:46:57.070449 24978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:46:57.070672 24978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:46:57.071817 24978 hybrid_clock.cc:648] HybridClock initialized: now 1786301217071806 us; error 27 us; skew 500 ppm
Aug 09 18:46:57 dist-test-slave-45dx krb5kdc[23081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301217, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:46:57.074409 24978 init.cc:377] Logged in from keytab as oryx/127.12.202.195@KRBTEST.COM (short username oryx)
I20260809 18:46:57.074875 24978 webserver.cc:460] Webserver started at http://127.12.202.195:37465/ using document root <none> and password file <none>
I20260809 18:46:57.075140 24978 fs_manager.cc:359] Metadata directory not provided
I20260809 18:46:57.075201 24978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:46:57.076785 24978 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 18:46:57.077323 25000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:57.077543 24978 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:46:57.077632 24978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "68ec9d0f9a134739813d3d6b8636e56e"
format_stamp: "Formatted at 2026-08-09 18:46:56 on dist-test-slave-45dx"
server_key: "ce7bfefafbf0e6968924d6d697dbbddc"
server_key_iv: "705e3a45a2cd43f3e229391b48140031"
server_key_version: "encryptionkey@0"
I20260809 18:46:57.077976 24978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:46:57.097108 24978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:46:57.099200 24978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:46:57.099324 24978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:46:57.099543 24978 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:46:57.099879 24978 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:46:57.099929 24978 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:57.099952 24978 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:46:57.100003 24978 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:46:57.107486 24978 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:36585
I20260809 18:46:57.107641 25209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:36585 every 8 connection(s)
I20260809 18:46:57.108021 24978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:46:57.114858 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 24978
Aug 09 18:46:57 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301217, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.252@KRBTEST.COM
Aug 09 18:46:57 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301217, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.253@KRBTEST.COM
Aug 09 18:46:57 dist-test-slave-45dx krb5kdc[23081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301217, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM
I20260809 18:46:57.121337 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.109641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:33923 (local address 127.12.202.253:41855)
0809 18:46:57.109686 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:57.109688 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:57.109698 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:46:57.110926 (+ 1228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:57.110928 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:57.110943 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:57.111001 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:57.111985 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.112526 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.114073 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.114374 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.114443 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.117726 (+ 3283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:57.117728 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:57.117728 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:57.117736 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:57.119637 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:57.120188 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:57.120189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:57.120190 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:57.120245 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:57.120569 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:57.120570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:57.120571 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:57.120714 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:57.120759 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:57.121146 (+ 387us) server_negotiation.cc:299] Negotiation successful
0809 18:46:57.121226 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:46:57.122123 25216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.109498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:41855 (local address 127.12.202.195:33923)
0809 18:46:57.109622 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:57.109631 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:57.110816 (+ 1185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:57.111076 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:57.111080 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:57.111616 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:57.111859 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:57.111861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.112708 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.112709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:57.113970 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:57.113971 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.114498 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.114499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:57.114652 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.115274 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:57.115279 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:57.117619 (+ 2340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:57.119743 (+ 2124us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:57.119751 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:57.119753 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:57.120090 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:57.120348 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:57.120349 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:57.120350 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:57.120486 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:57.120808 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:57.120814 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:57.120989 (+ 175us) client_negotiation.cc:769] Sending connection context
0809 18:46:57.121710 (+ 721us) client_negotiation.cc:240] Negotiation successful
0809 18:46:57.121924 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"mutex_wait_us":166,"thread_start_us":77,"threads_started":1}
I20260809 18:46:57.122171 25214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.108928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35433 (local address 127.12.202.195:49747)
0809 18:46:57.109300 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:57.109342 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:57.110807 (+ 1465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:57.111076 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:57.111080 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:57.111613 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:57.111892 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:57.111893 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.112751 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.112752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:57.113698 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:57.113701 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.114134 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.114134 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:57.114306 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.114948 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:57.114959 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:57.118833 (+ 3874us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:57.120724 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:57.120725 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:57.120726 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:57.120949 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:57.121154 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:57.121155 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:57.121155 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:57.121213 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:57.121516 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:57.121517 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:57.121560 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 18:46:57.121641 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 18:46:57.121868 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":5,"thread_start_us":308,"threads_started":1}
I20260809 18:46:57.122450 24745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.108963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:49747 (local address 127.12.202.252:35433)
0809 18:46:57.109034 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:57.109036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:57.109429 (+ 393us) server_negotiation.cc:407] Connection header received
0809 18:46:57.110943 (+ 1514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:57.110945 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:57.110957 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:57.110988 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:57.111953 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.112667 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.113799 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.114054 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.114126 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.118945 (+ 4819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:57.118947 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:57.118947 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:57.118955 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:57.120645 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:57.121029 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:57.121031 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:57.121031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:57.121088 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:57.121276 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:57.121277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:57.121278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:57.121415 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:57.121485 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:57.122264 (+ 779us) server_negotiation.cc:299] Negotiation successful
0809 18:46:57.122349 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:46:57.122470 25215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.108928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:41753)
0809 18:46:57.109460 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:57.109471 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:57.110850 (+ 1379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:57.111085 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:57.111086 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:57.111471 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:46:57.111757 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:57.111763 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.112708 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.112709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:57.113913 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:57.113924 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.114379 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.114380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:57.114442 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.115564 (+ 1122us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:46:57.115569 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:46:57.118128 (+ 2559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:46:57.120708 (+ 2580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:57.120708 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:57.120709 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:57.121035 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:57.121551 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:46:57.121552 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:46:57.121552 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:46:57.121615 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:46:57.121973 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:46:57.121974 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:46:57.122022 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 18:46:57.122095 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 18:46:57.122196 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"mutex_wait_us":25,"thread_start_us":295,"threads_started":1}
I20260809 18:46:57.122752 23212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.108935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:41753 (local address 127.12.202.254:42525)
0809 18:46:57.109108 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:57.109110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:57.109542 (+ 432us) server_negotiation.cc:407] Connection header received
0809 18:46:57.110975 (+ 1433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:57.110976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:57.110989 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:57.111019 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:57.111861 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.112636 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.114022 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.114291 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.114378 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.118264 (+ 3886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:57.118266 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:57.118266 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:57.118278 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:57.120630 (+ 2352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:57.121403 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:57.121405 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:57.121405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:57.121471 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:57.121703 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:57.121704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:57.121704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:57.121872 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:57.121942 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:57.122584 (+ 642us) server_negotiation.cc:299] Negotiation successful
0809 18:46:57.122664 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260809 18:46:57.122943 25210 heartbeater.cc:347] Connected to a master server at 127.12.202.252:35433
I20260809 18:46:57.122979 25212 heartbeater.cc:347] Connected to a master server at 127.12.202.253:41855
I20260809 18:46:57.123046 25210 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:57.123195 25211 heartbeater.cc:347] Connected to a master server at 127.12.202.254:42525
I20260809 18:46:57.123234 25211 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:57.123273 25210 heartbeater.cc:511] Master 127.12.202.252:35433 requested a full tablet report, sending...
I20260809 18:46:57.123314 25211 heartbeater.cc:511] Master 127.12.202.254:42525 requested a full tablet report, sending...
I20260809 18:46:57.123047 25212 heartbeater.cc:464] Registering TS with master...
I20260809 18:46:57.123602 25212 heartbeater.cc:511] Master 127.12.202.253:41855 requested a full tablet report, sending...
I20260809 18:46:57.123682 23142 ts_manager.cc:194] Re-registered known tserver with Master: 68ec9d0f9a134739813d3d6b8636e56e (127.12.202.195:36585)
I20260809 18:46:57.123787 24438 ts_manager.cc:194] Registered new tserver with Master: 68ec9d0f9a134739813d3d6b8636e56e (127.12.202.195:36585)
I20260809 18:46:57.124164 23142 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:41753
I20260809 18:46:57.125159 24120 ts_manager.cc:194] Registered new tserver with Master: 68ec9d0f9a134739813d3d6b8636e56e (127.12.202.195:36585)
I20260809 18:46:57.127162 25226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.116946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50794 (local address 127.12.202.252:35433)
0809 18:46:57.117065 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:57.117067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:57.117292 (+ 225us) server_negotiation.cc:407] Connection header received
0809 18:46:57.117394 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:57.117395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:57.117410 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:57.117450 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:57.118529 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.119308 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.120434 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.120780 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.120829 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.123994 (+ 3165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:57.123994 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:57.123995 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:57.124001 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:57.125820 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:57.126162 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:57.126163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:57.126163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:57.126224 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:57.126456 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:57.126458 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:57.126458 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:57.126620 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:57.126715 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:57.126934 (+ 219us) server_negotiation.cc:299] Negotiation successful
0809 18:46:57.127026 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":80,"threads_started":1}
I20260809 18:46:57.130927 25225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.116715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38070 (local address 127.12.202.253:41855)
0809 18:46:57.116815 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:57.116817 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:57.116826 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:46:57.116925 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:57.116926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:57.116944 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:57.117002 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:57.123829 (+ 6827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.124650 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.126236 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.126529 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.126597 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.128059 (+ 1462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:57.128061 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:57.128061 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:57.128068 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:57.129758 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:57.130115 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:57.130117 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:57.130117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:57.130179 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:57.130397 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:57.130398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:57.130398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:57.130517 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:57.130622 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:57.130735 (+ 113us) server_negotiation.cc:299] Negotiation successful
0809 18:46:57.130815 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":47,"threads_started":1}
I20260809 18:46:57.131072 25230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.117403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43708 (local address 127.12.202.254:42525)
0809 18:46:57.117846 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:57.117848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:57.118334 (+ 486us) server_negotiation.cc:407] Connection header received
0809 18:46:57.118420 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:57.118421 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:57.118435 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:57.123091 (+ 4656us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:57.124593 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.125376 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.126418 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.126707 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.126870 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.128385 (+ 1515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:57.128386 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:57.128386 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:57.128393 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:57.129909 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:57.130267 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:57.130268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:57.130268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:57.130334 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:57.130540 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:57.130541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:57.130542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:57.130671 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:57.130775 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:57.130879 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 18:46:57.130963 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":145,"threads_started":1}
I20260809 18:46:57.132691 23142 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43708:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:46:57.134335 23142 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:46:57.143029 25249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.138915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58958 (local address 127.12.202.193:46081)
0809 18:46:57.139163 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:57.139167 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:57.139176 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:46:57.139221 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:57.139223 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:57.139237 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:57.139335 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:57.139474 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.140420 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.141907 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.142566 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.142744 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.142813 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:57.142840 (+ 27us) server_negotiation.cc:299] Negotiation successful
0809 18:46:57.142895 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":122,"threads_started":1}
I20260809 18:46:57.143365 25241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.138197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:46081 (local address 127.0.0.1:58958)
0809 18:46:57.138609 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:57.138621 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:57.138690 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:57.139332 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:57.139333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:57.139335 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:57.139418 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:57.139419 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.140505 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.140506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:57.141809 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:57.141812 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.142657 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.142658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:57.142759 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.142763 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:46:57.142807 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 18:46:57.143254 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":2,"thread_start_us":266,"threads_started":1}
I20260809 18:46:57.143649 25246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.138244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:36585 (local address 127.0.0.1:35266)
0809 18:46:57.138655 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:57.138665 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:57.138708 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:57.139792 (+ 1084us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:57.139793 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:57.139795 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:57.139904 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:57.139906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.141224 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.141225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:57.141987 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:57.141989 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.143272 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.143273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:57.143410 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.143414 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:46:57.143476 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 18:46:57.143525 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"mutex_wait_us":21,"thread_start_us":326,"threads_started":1}
I20260809 18:46:57.143949 25244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.138349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58072 (local address 127.12.202.194:44151)
0809 18:46:57.139171 (+ 822us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:57.139175 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:57.139185 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:46:57.139241 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:57.139243 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:57.139256 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:57.139358 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:57.139607 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.140928 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.142247 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.143081 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.143244 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.143302 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:57.143728 (+ 426us) server_negotiation.cc:299] Negotiation successful
0809 18:46:57.143781 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":781,"thread_start_us":130,"threads_started":1}
I20260809 18:46:57.143684 25242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.138197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:44151 (local address 127.0.0.1:58072)
0809 18:46:57.138560 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:57.138574 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:57.138821 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:57.139368 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:57.139369 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:57.139372 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:57.139507 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:57.139510 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.141017 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.141018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:57.142166 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:57.142168 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.143333 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.143333 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:57.143478 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.143482 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:46:57.143529 (+ 47us) client_negotiation.cc:240] Negotiation successful
0809 18:46:57.143560 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"mutex_wait_us":24,"spinlock_wait_cycles":384,"thread_start_us":260,"threads_started":1}
I20260809 18:46:57.144176 25247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.138606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35266 (local address 127.12.202.195:36585)
0809 18:46:57.139565 (+ 959us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:57.139569 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:57.139580 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:46:57.139635 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:57.139637 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:57.139653 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:57.139985 (+ 332us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:57.140045 (+ 60us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.141145 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.142079 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.143074 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.143885 (+ 811us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.143969 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:57.143997 (+ 28us) server_negotiation.cc:299] Negotiation successful
0809 18:46:57.144046 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":898,"thread_start_us":129,"threads_started":1}
I20260809 18:46:57.144479 24636 tablet_service.cc:1467] Processing CreateTablet for tablet 09c797680f14478288bd14f421a352a0 (DEFAULT_TABLE table=test-table [id=b9ccdc8f2994435aa3e77d5e984d8838]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:57.144806 24860 tablet_service.cc:1467] Processing CreateTablet for tablet 09c797680f14478288bd14f421a352a0 (DEFAULT_TABLE table=test-table [id=b9ccdc8f2994435aa3e77d5e984d8838]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:57.144956 24636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09c797680f14478288bd14f421a352a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:57.144956 25082 tablet_service.cc:1467] Processing CreateTablet for tablet 09c797680f14478288bd14f421a352a0 (DEFAULT_TABLE table=test-table [id=b9ccdc8f2994435aa3e77d5e984d8838]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:46:57.145179 24860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09c797680f14478288bd14f421a352a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:57.145290 25082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09c797680f14478288bd14f421a352a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:46:57.148837 25251 tablet_bootstrap.cc:492] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e: Bootstrap starting.
I20260809 18:46:57.150096 25251 tablet_bootstrap.cc:654] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:57.150522 25252 tablet_bootstrap.cc:492] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c: Bootstrap starting.
I20260809 18:46:57.150846 25251 log.cc:824] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:57.151224 25255 tablet_bootstrap.cc:492] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e: Bootstrap starting.
I20260809 18:46:57.151489 25252 tablet_bootstrap.cc:654] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:57.152035 25252 log.cc:824] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:57.152339 25251 tablet_bootstrap.cc:492] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e: No bootstrap required, opened a new log
I20260809 18:46:57.152421 25255 tablet_bootstrap.cc:654] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e: Neither blocks nor log segments found. Creating new log.
I20260809 18:46:57.152431 25251 ts_tablet_manager.cc:1397] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260809 18:46:57.152817 25252 tablet_bootstrap.cc:492] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c: No bootstrap required, opened a new log
I20260809 18:46:57.152946 25252 ts_tablet_manager.cc:1397] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:46:57.153180 25255 log.cc:824] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e: Log is configured to *not* fsync() on all Append() calls
I20260809 18:46:57.154366 25255 tablet_bootstrap.cc:492] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e: No bootstrap required, opened a new log
I20260809 18:46:57.154503 25255 ts_tablet_manager.cc:1397] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20260809 18:46:57.155368 25251 raft_consensus.cc:348] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c2d7a50f3440cf855f7410f086f40e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 44151 } } peers { permanent_uuid: "f439a24beb614ddf9e1111e805f09f7c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 46081 } } peers { permanent_uuid: "68ec9d0f9a134739813d3d6b8636e56e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36585 } }
I20260809 18:46:57.155514 25251 raft_consensus.cc:374] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:57.155534 25251 raft_consensus.cc:729] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97c2d7a50f3440cf855f7410f086f40e, State: Initialized, Role: FOLLOWER
I20260809 18:46:57.155644 25251 consensus_queue.cc:260] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c2d7a50f3440cf855f7410f086f40e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 44151 } } peers { permanent_uuid: "f439a24beb614ddf9e1111e805f09f7c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 46081 } } peers { permanent_uuid: "68ec9d0f9a134739813d3d6b8636e56e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36585 } }
I20260809 18:46:57.155977 25251 ts_tablet_manager.cc:1428] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260809 18:46:57.156075 24967 heartbeater.cc:503] Master 127.12.202.254:42525 was elected leader, sending a full tablet report...
I20260809 18:46:57.157490 25252 raft_consensus.cc:348] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c2d7a50f3440cf855f7410f086f40e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 44151 } } peers { permanent_uuid: "f439a24beb614ddf9e1111e805f09f7c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 46081 } } peers { permanent_uuid: "68ec9d0f9a134739813d3d6b8636e56e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36585 } }
I20260809 18:46:57.157639 25252 raft_consensus.cc:374] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:57.157684 25252 raft_consensus.cc:729] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f439a24beb614ddf9e1111e805f09f7c, State: Initialized, Role: FOLLOWER
I20260809 18:46:57.157788 25252 consensus_queue.cc:260] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c2d7a50f3440cf855f7410f086f40e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 44151 } } peers { permanent_uuid: "f439a24beb614ddf9e1111e805f09f7c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 46081 } } peers { permanent_uuid: "68ec9d0f9a134739813d3d6b8636e56e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36585 } }
I20260809 18:46:57.158052 25252 ts_tablet_manager.cc:1428] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260809 18:46:57.158187 24734 heartbeater.cc:503] Master 127.12.202.254:42525 was elected leader, sending a full tablet report...
I20260809 18:46:57.158367 25255 raft_consensus.cc:348] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c2d7a50f3440cf855f7410f086f40e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 44151 } } peers { permanent_uuid: "f439a24beb614ddf9e1111e805f09f7c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 46081 } } peers { permanent_uuid: "68ec9d0f9a134739813d3d6b8636e56e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36585 } }
I20260809 18:46:57.158557 25255 raft_consensus.cc:374] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:46:57.158600 25255 raft_consensus.cc:729] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ec9d0f9a134739813d3d6b8636e56e, State: Initialized, Role: FOLLOWER
I20260809 18:46:57.158701 25255 consensus_queue.cc:260] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c2d7a50f3440cf855f7410f086f40e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 44151 } } peers { permanent_uuid: "f439a24beb614ddf9e1111e805f09f7c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 46081 } } peers { permanent_uuid: "68ec9d0f9a134739813d3d6b8636e56e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36585 } }
I20260809 18:46:57.158972 25255 ts_tablet_manager.cc:1428] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260809 18:46:57.159076 25211 heartbeater.cc:503] Master 127.12.202.254:42525 was elected leader, sending a full tablet report...
I20260809 18:46:57.180692 25260 raft_consensus.cc:482] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:46:57.180814 25260 raft_consensus.cc:504] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c2d7a50f3440cf855f7410f086f40e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 44151 } } peers { permanent_uuid: "f439a24beb614ddf9e1111e805f09f7c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 46081 } } peers { permanent_uuid: "68ec9d0f9a134739813d3d6b8636e56e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36585 } }
I20260809 18:46:57.181227 25260 leader_election.cc:288] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97c2d7a50f3440cf855f7410f086f40e (127.12.202.194:44151), 68ec9d0f9a134739813d3d6b8636e56e (127.12.202.195:36585)
I20260809 18:46:57.184576 25247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.181525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:55831 (local address 127.12.202.195:36585)
0809 18:46:57.181573 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:57.181576 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:57.181586 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:46:57.181648 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:57.181649 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:57.181659 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:57.181745 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:57.182053 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.182529 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.183810 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.184157 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.184243 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.184260 (+ 17us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:57.184469 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 18:46:57.184508 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:46:57.184578 24744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.181409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:36585 (local address 127.12.202.193:55831)
0809 18:46:57.181519 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:57.181531 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:57.181578 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:57.181750 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:57.181793 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:57.181795 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:57.181954 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:57.181956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.182613 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.182614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:57.183716 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:57.183719 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.184240 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.184241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:57.184387 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.184391 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:46:57.184462 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 18:46:57.184505 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":1}
I20260809 18:46:57.184852 24741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.181514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:44151 (local address 127.12.202.193:54825)
0809 18:46:57.181565 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:57.181577 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:46:57.181638 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:46:57.181817 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:46:57.181817 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:46:57.181819 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:46:57.181951 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:57.181953 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.182958 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.182959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:57.183881 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:46:57.183883 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.184448 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.184449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:46:57.184592 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.184594 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:46:57.184665 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 18:46:57.184714 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260809 18:46:57.184939 25244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.181500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:54825 (local address 127.12.202.194:44151)
0809 18:46:57.181591 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:57.181593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:57.181628 (+ 35us) server_negotiation.cc:407] Connection header received
0809 18:46:57.181704 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:57.181705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:57.181715 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:57.181814 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:46:57.182034 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.182850 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.183970 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.184361 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.184449 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.184456 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:57.184791 (+ 335us) server_negotiation.cc:299] Negotiation successful
0809 18:46:57.184865 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 18:46:57.185031 25124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c797680f14478288bd14f421a352a0" candidate_uuid: "f439a24beb614ddf9e1111e805f09f7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ec9d0f9a134739813d3d6b8636e56e" is_pre_election: true
I20260809 18:46:57.185217 25124 raft_consensus.cc:2454] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f439a24beb614ddf9e1111e805f09f7c in term 0.
I20260809 18:46:57.185510 24886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c797680f14478288bd14f421a352a0" candidate_uuid: "f439a24beb614ddf9e1111e805f09f7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c2d7a50f3440cf855f7410f086f40e" is_pre_election: true
I20260809 18:46:57.185540 24561 leader_election.cc:302] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ec9d0f9a134739813d3d6b8636e56e, f439a24beb614ddf9e1111e805f09f7c; no voters:
I20260809 18:46:57.185638 24886 raft_consensus.cc:2454] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f439a24beb614ddf9e1111e805f09f7c in term 0.
I20260809 18:46:57.185774 25260 raft_consensus.cc:2781] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:46:57.185846 25260 raft_consensus.cc:482] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:46:57.185871 25260 raft_consensus.cc:3037] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:57.186707 25260 raft_consensus.cc:504] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c2d7a50f3440cf855f7410f086f40e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 44151 } } peers { permanent_uuid: "f439a24beb614ddf9e1111e805f09f7c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 46081 } } peers { permanent_uuid: "68ec9d0f9a134739813d3d6b8636e56e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36585 } }
I20260809 18:46:57.186864 25260 leader_election.cc:288] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [CANDIDATE]: Term 1 election: Requested vote from peers 97c2d7a50f3440cf855f7410f086f40e (127.12.202.194:44151), 68ec9d0f9a134739813d3d6b8636e56e (127.12.202.195:36585)
I20260809 18:46:57.187065 25124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c797680f14478288bd14f421a352a0" candidate_uuid: "f439a24beb614ddf9e1111e805f09f7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ec9d0f9a134739813d3d6b8636e56e"
I20260809 18:46:57.187063 24886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09c797680f14478288bd14f421a352a0" candidate_uuid: "f439a24beb614ddf9e1111e805f09f7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97c2d7a50f3440cf855f7410f086f40e"
I20260809 18:46:57.187153 25124 raft_consensus.cc:3037] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:46:57.187153 24886 raft_consensus.cc:3037] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e [term 0 FOLLOWER]: Advancing to term 1
W20260809 18:46:57.187570 24969 tablet.cc:2369] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:46:57.188666 24886 raft_consensus.cc:2454] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f439a24beb614ddf9e1111e805f09f7c in term 1.
I20260809 18:46:57.188939 24559 leader_election.cc:302] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97c2d7a50f3440cf855f7410f086f40e, f439a24beb614ddf9e1111e805f09f7c; no voters:
I20260809 18:46:57.189013 25124 raft_consensus.cc:2454] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f439a24beb614ddf9e1111e805f09f7c in term 1.
I20260809 18:46:57.189074 25260 raft_consensus.cc:2781] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:46:57.189316 25260 raft_consensus.cc:686] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [term 1 LEADER]: Becoming Leader. State: Replica: f439a24beb614ddf9e1111e805f09f7c, State: Running, Role: LEADER
I20260809 18:46:57.189674 25260 consensus_queue.cc:237] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c2d7a50f3440cf855f7410f086f40e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 44151 } } peers { permanent_uuid: "f439a24beb614ddf9e1111e805f09f7c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 46081 } } peers { permanent_uuid: "68ec9d0f9a134739813d3d6b8636e56e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36585 } }
I20260809 18:46:57.190547 23142 catalog_manager.cc:5495] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c reported cstate change: term changed from 0 to 1, leader changed from <none> to f439a24beb614ddf9e1111e805f09f7c (127.12.202.193). New cstate: current_term: 1 leader_uuid: "f439a24beb614ddf9e1111e805f09f7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97c2d7a50f3440cf855f7410f086f40e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f439a24beb614ddf9e1111e805f09f7c" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68ec9d0f9a134739813d3d6b8636e56e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36585 } health_report { overall_health: UNKNOWN } } }
I20260809 18:46:57.199582 25249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.197338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58964 (local address 127.12.202.193:46081)
0809 18:46:57.197398 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:57.197400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:57.197407 (+ 7us) server_negotiation.cc:407] Connection header received
0809 18:46:57.197455 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:57.197455 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:57.197471 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:57.197527 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:46:57.197648 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.198079 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.198874 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.199051 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.199100 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.199246 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:46:57.199346 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:46:57.199407 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:57.199490 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 18:46:57.199506 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 18:46:57.201859 25124 raft_consensus.cc:1261] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e [term 1 FOLLOWER]: Refusing update from remote peer f439a24beb614ddf9e1111e805f09f7c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:57.201859 24886 raft_consensus.cc:1261] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e [term 1 FOLLOWER]: Refusing update from remote peer f439a24beb614ddf9e1111e805f09f7c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:46:57.202186 25260 consensus_queue.cc:1035] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "97c2d7a50f3440cf855f7410f086f40e" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:57.202379 25265 consensus_queue.cc:1035] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ec9d0f9a134739813d3d6b8636e56e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:46:57.207823 25272 mvcc.cc:205] Tried to move back new op lower bound from 7316689785655808000 to 7316689785609568256. Current Snapshot: MvccSnapshot[applied={T|T < 7316689785655808000}]
I20260809 18:46:57.208325 25273 mvcc.cc:205] Tried to move back new op lower bound from 7316689785655808000 to 7316689785609568256. Current Snapshot: MvccSnapshot[applied={T|T < 7316689785655808000 or (T in {7316689785655808000})}]
I20260809 18:46:57.209239 23142 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:46:57.209345 23142 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:46:57.210736 23142 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 38c653ab2b3049afbdfe338bd9aeddbe: Sending DeleteTablet for 3 replicas of tablet 09c797680f14478288bd14f421a352a0
I20260809 18:46:57.211232 24860 tablet_service.cc:1514] Processing DeleteTablet for tablet 09c797680f14478288bd14f421a352a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:57 UTC) from {username='oryx', principal='oryx/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:58072
I20260809 18:46:57.211262 25082 tablet_service.cc:1514] Processing DeleteTablet for tablet 09c797680f14478288bd14f421a352a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:57 UTC) from {username='oryx', principal='oryx/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:35266
I20260809 18:46:57.211463 25284 tablet_replica.cc:330] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e: stopping tablet replica
I20260809 18:46:57.211594 24636 tablet_service.cc:1514] Processing DeleteTablet for tablet 09c797680f14478288bd14f421a352a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:46:57 UTC) from {username='oryx', principal='oryx/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:58958
I20260809 18:46:57.211622 25284 raft_consensus.cc:2229] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:46:57.211802 25284 raft_consensus.cc:2258] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:57.212057 25287 tablet_replica.cc:330] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c: stopping tablet replica
I20260809 18:46:57.212170 25287 raft_consensus.cc:2229] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:46:57.212261 25287 raft_consensus.cc:2258] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:57.212661 25287 ts_tablet_manager.cc:1905] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:57.212661 25284 ts_tablet_manager.cc:1905] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:57.212795 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 23100
I20260809 18:46:57.215271 25284 ts_tablet_manager.cc:1918] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:46:57.215349 25284 log.cc:1196] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/09c797680f14478288bd14f421a352a0
I20260809 18:46:57.215667 25284 ts_tablet_manager.cc:1939] T 09c797680f14478288bd14f421a352a0 P 97c2d7a50f3440cf855f7410f086f40e: Deleting consensus metadata
I20260809 18:46:57.228125 25287 ts_tablet_manager.cc:1918] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:46:57.228253 25287 log.cc:1196] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-0/wal/wals/09c797680f14478288bd14f421a352a0
I20260809 18:46:57.228581 25287 ts_tablet_manager.cc:1939] T 09c797680f14478288bd14f421a352a0 P f439a24beb614ddf9e1111e805f09f7c: Deleting consensus metadata
I20260809 18:46:57.233563 25286 tablet_replica.cc:330] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e: stopping tablet replica
I20260809 18:46:57.233726 25286 raft_consensus.cc:2229] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:46:57.233877 25286 raft_consensus.cc:2258] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:46:57.234489 25286 ts_tablet_manager.cc:1905] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:46:57.236639 25286 ts_tablet_manager.cc:1918] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:46:57.236794 25286 log.cc:1196] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/09c797680f14478288bd14f421a352a0
I20260809 18:46:57.237188 25286 ts_tablet_manager.cc:1939] T 09c797680f14478288bd14f421a352a0 P 68ec9d0f9a134739813d3d6b8636e56e: Deleting consensus metadata
W20260809 18:46:57.238690 24561 connection.cc:535] server connection from 127.0.0.1:58958 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 18:46:57.238938 24781 connection.cc:535] server connection from 127.0.0.1:58072 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 18:46:57.238701 25006 connection.cc:535] server connection from 127.0.0.1:35266 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 18:46:57.242588 25226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.212464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50808 (local address 127.12.202.252:35433)
0809 18:46:57.212505 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:57.212507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:57.212516 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:46:57.212538 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:57.212539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:57.212552 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:57.212628 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:57.233488 (+ 20860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.234298 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.235412 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.235718 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.235762 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.238505 (+ 2743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:57.238507 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:57.238507 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:57.238516 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:57.240934 (+ 2418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:57.241442 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:57.241443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:57.241444 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:57.241509 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:57.241724 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:57.241725 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:57.241725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:57.241896 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:57.242374 (+ 478us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:57.242417 (+ 43us) server_negotiation.cc:299] Negotiation successful
0809 18:46:57.242495 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:46:57.248363 24745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.240979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50824 (local address 127.12.202.252:35433)
0809 18:46:57.241022 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:57.241024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:57.241201 (+ 177us) server_negotiation.cc:407] Connection header received
0809 18:46:57.241295 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:57.241296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:57.241308 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:57.241339 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:57.242111 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.242791 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.243633 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.243891 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.243955 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.245560 (+ 1605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:57.245561 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:57.245562 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:57.245569 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:57.247095 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:57.247435 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:57.247436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:57.247436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:57.247490 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:57.247700 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:57.247702 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:57.247703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:57.247864 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:57.247978 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:57.248126 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 18:46:57.248215 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:46:57.249682 25225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:57.240653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38076 (local address 127.12.202.253:41855)
0809 18:46:57.241037 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0809 18:46:57.241039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:46:57.241116 (+ 77us) server_negotiation.cc:407] Connection header received
0809 18:46:57.241262 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:46:57.241263 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:46:57.241280 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:46:57.241323 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:46:57.242874 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.243727 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.244598 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:46:57.244818 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:46:57.244906 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:46:57.246267 (+ 1361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:46:57.246268 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:46:57.246269 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:46:57.246277 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:46:57.248530 (+ 2253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:57.248893 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:57.248895 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:57.248895 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:57.248966 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:46:57.249157 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:46:57.249158 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:46:57.249158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:46:57.249302 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:46:57.249430 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 18:46:57.249488 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 18:46:57.249581 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356}
I20260809 18:46:58.207960 25302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:58.207619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:45535)
0809 18:46:58.207798 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:58.207896 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":72,"threads_started":1}
W20260809 18:46:58.208237 25211 heartbeater.cc:644] Failed to heartbeat to 127.12.202.254:42525 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
I20260809 18:46:58.208587 25304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:58.208257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:59241)
0809 18:46:58.208441 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:58.208534 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":115,"threads_started":1}
I20260809 18:46:58.208842 25305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:58.208595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:56525)
0809 18:46:58.208724 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:58.208795 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":54,"threads_started":1}
W20260809 18:46:58.208941 24734 heartbeater.cc:644] Failed to heartbeat to 127.12.202.254:42525 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
W20260809 18:46:58.208993 24967 heartbeater.cc:644] Failed to heartbeat to 127.12.202.254:42525 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
I20260809 18:46:58.711520 25307 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 38c653ab2b3049afbdfe338bd9aeddbe)
I20260809 18:46:58.711650 25307 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: false } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } }
I20260809 18:46:58.711887 25307 leader_election.cc:288] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38c653ab2b3049afbdfe338bd9aeddbe (127.12.202.254:42525)
I20260809 18:46:58.712229 25309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:58.712035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:44190)
0809 18:46:58.712134 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:58.712189 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81,"thread_start_us":45,"threads_started":1}
W20260809 18:46:58.712420 24093 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
I20260809 18:46:58.712831 25309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:58.712716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:44198)
0809 18:46:58.712762 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:58.712811 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 18:46:58.712971 24093 leader_election.cc:334] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 38c653ab2b3049afbdfe338bd9aeddbe (127.12.202.254:42525): Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
I20260809 18:46:58.713068 24093 leader_election.cc:302] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 28393c9c23b84c1593caa876aa7c6696; no voters: 38c653ab2b3049afbdfe338bd9aeddbe
I20260809 18:46:58.713197 25307 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:46:59.208832 25313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:59.208603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:58671)
0809 18:46:59.208726 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:59.208770 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":74,"threads_started":1}
I20260809 18:46:59.209610 25318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:59.209249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:48651)
0809 18:46:59.209495 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:59.209556 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":55,"threads_started":1}
I20260809 18:46:59.209784 25319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:46:59.209435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:38033)
0809 18:46:59.209640 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 18:46:59.209739 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":73,"threads_started":1}
I20260809 18:47:00.209735 25321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:00.209355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:53257)
0809 18:47:00.209616 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:00.209669 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":61,"threads_started":1}
I20260809 18:47:00.210420 25324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:00.210158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:46511)
0809 18:47:00.210304 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:00.210368 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":50,"threads_started":1}
I20260809 18:47:00.210532 25323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:00.210075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:49833)
0809 18:47:00.210441 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:00.210479 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":50,"threads_started":1}
I20260809 18:47:00.757841 25325 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 38c653ab2b3049afbdfe338bd9aeddbe)
I20260809 18:47:00.757937 25325 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: false } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } }
I20260809 18:47:00.758131 25325 leader_election.cc:288] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38c653ab2b3049afbdfe338bd9aeddbe (127.12.202.254:42525)
I20260809 18:47:00.758466 25326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:00.758264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:44506)
0809 18:47:00.758376 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:00.758414 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":61,"threads_started":1}
I20260809 18:47:00.758980 25326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:00.758871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:44508)
0809 18:47:00.758925 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:00.758958 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260809 18:47:00.759083 24093 leader_election.cc:334] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 38c653ab2b3049afbdfe338bd9aeddbe (127.12.202.254:42525): Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
I20260809 18:47:00.759131 24093 leader_election.cc:302] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 28393c9c23b84c1593caa876aa7c6696; no voters: 38c653ab2b3049afbdfe338bd9aeddbe
I20260809 18:47:00.759198 25325 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:47:01.210690 25328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:01.210447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:47597)
0809 18:47:01.210577 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:01.210619 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":85,"threads_started":1}
I20260809 18:47:01.211199 25330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:01.211001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:51653)
0809 18:47:01.211123 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:01.211154 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":58,"threads_started":1}
I20260809 18:47:01.211205 25329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:01.210962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:51581)
0809 18:47:01.211122 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:01.211156 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":55,"threads_started":1}
I20260809 18:47:02.211637 25332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:02.211381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:51967)
0809 18:47:02.211527 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:02.211571 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":70,"threads_started":1}
I20260809 18:47:02.211875 25335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:02.211660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:50119)
0809 18:47:02.211784 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:02.211825 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":54,"threads_started":1}
I20260809 18:47:02.211990 25334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:02.211485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:55147)
0809 18:47:02.211904 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:02.211941 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":72,"threads_started":1}
I20260809 18:47:02.810846 25336 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 38c653ab2b3049afbdfe338bd9aeddbe)
I20260809 18:47:02.810951 25336 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: false } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } }
I20260809 18:47:02.811097 25336 leader_election.cc:288] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38c653ab2b3049afbdfe338bd9aeddbe (127.12.202.254:42525)
I20260809 18:47:02.811471 25337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:02.811249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:47824)
0809 18:47:02.811374 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:02.811421 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":66,"threads_started":1}
I20260809 18:47:02.811895 25337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:02.811811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:47838)
0809 18:47:02.811853 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:02.811878 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260809 18:47:02.811997 24093 leader_election.cc:334] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 38c653ab2b3049afbdfe338bd9aeddbe (127.12.202.254:42525): Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
I20260809 18:47:02.812057 24093 leader_election.cc:302] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 28393c9c23b84c1593caa876aa7c6696; no voters: 38c653ab2b3049afbdfe338bd9aeddbe
I20260809 18:47:02.812134 25336 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:47:03.212483 25341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:03.212157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:39895)
0809 18:47:03.212376 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:03.212419 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":114,"threads_started":1}
I20260809 18:47:03.212929 25342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:03.212405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:58117)
0809 18:47:03.212840 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:03.212882 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":60,"threads_started":1}
I20260809 18:47:03.212963 25343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:03.212426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:44919)
0809 18:47:03.212888 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:03.212921 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":50,"threads_started":1}
I20260809 18:47:04.213339 25345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:04.213081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:41599)
0809 18:47:04.213233 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:04.213277 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":72,"threads_started":1}
I20260809 18:47:04.213554 25346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:04.213348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:56897)
0809 18:47:04.213464 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:04.213500 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":69,"threads_started":1}
I20260809 18:47:04.213572 25347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:04.213383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:43995)
0809 18:47:04.213494 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:04.213523 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":52,"threads_started":1}
I20260809 18:47:05.148765 25348 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 38c653ab2b3049afbdfe338bd9aeddbe)
I20260809 18:47:05.148922 25348 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: false } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } }
I20260809 18:47:05.149113 25348 leader_election.cc:288] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38c653ab2b3049afbdfe338bd9aeddbe (127.12.202.254:42525)
I20260809 18:47:05.149510 25351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:05.149296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:48002)
0809 18:47:05.149433 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:05.149470 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":83,"threads_started":1}
W20260809 18:47:05.149601 24093 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111) [suppressed 2 similar messages]
I20260809 18:47:05.149995 25351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:05.149891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:48006)
0809 18:47:05.149944 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:05.149974 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 18:47:05.150095 24093 leader_election.cc:334] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 38c653ab2b3049afbdfe338bd9aeddbe (127.12.202.254:42525): Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
I20260809 18:47:05.150164 24093 leader_election.cc:302] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 28393c9c23b84c1593caa876aa7c6696; no voters: 38c653ab2b3049afbdfe338bd9aeddbe
I20260809 18:47:05.150246 25348 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:47:05.214166 25353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:05.213862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:53487)
0809 18:47:05.214028 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:05.214070 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":85,"threads_started":1}
I20260809 18:47:05.214300 25354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:05.213946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:35323)
0809 18:47:05.214233 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:05.214260 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":60,"threads_started":1}
I20260809 18:47:05.214300 25355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:05.214130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:34755)
0809 18:47:05.214219 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:05.214256 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70,"thread_start_us":45,"threads_started":1}
I20260809 18:47:06.215013 25356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:06.214706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:57183)
0809 18:47:06.214912 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:06.214958 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":116,"threads_started":1}
I20260809 18:47:06.215013 25357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:06.214798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:59555)
0809 18:47:06.214928 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:06.214959 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
I20260809 18:47:06.215233 25360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:06.214915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:52863)
0809 18:47:06.215045 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:06.215185 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":76,"threads_started":1}
I20260809 18:47:07.215880 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:07.215668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:47737)
0809 18:47:07.215793 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:07.215833 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":56,"threads_started":1}
I20260809 18:47:07.215912 25362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:07.215472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:50821)
0809 18:47:07.215794 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:07.215833 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":58,"threads_started":1}
I20260809 18:47:07.216145 25361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:07.215451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:54689)
0809 18:47:07.216060 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:07.216100 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":80,"threads_started":1}
I20260809 18:47:08.216614 25366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:08.216340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:43793)
0809 18:47:08.216517 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:08.216561 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":96,"threads_started":1}
I20260809 18:47:08.216614 25368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:08.216371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:42931)
0809 18:47:08.216528 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:08.216561 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":85,"threads_started":1}
I20260809 18:47:08.216794 25369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:08.216549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:56579)
0809 18:47:08.216653 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:08.216690 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":62,"threads_started":1}
I20260809 18:47:09.076632 25370 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 38c653ab2b3049afbdfe338bd9aeddbe)
I20260809 18:47:09.076735 25370 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: false } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } }
I20260809 18:47:09.076936 25370 leader_election.cc:288] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38c653ab2b3049afbdfe338bd9aeddbe (127.12.202.254:42525)
I20260809 18:47:09.077313 25372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:09.077112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:48238)
0809 18:47:09.077242 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:09.077275 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":78,"threads_started":1}
I20260809 18:47:09.077728 25372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:09.077628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:48246)
0809 18:47:09.077674 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:09.077710 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 18:47:09.077803 24093 leader_election.cc:334] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 38c653ab2b3049afbdfe338bd9aeddbe (127.12.202.254:42525): Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
I20260809 18:47:09.077873 24093 leader_election.cc:302] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 28393c9c23b84c1593caa876aa7c6696; no voters: 38c653ab2b3049afbdfe338bd9aeddbe
I20260809 18:47:09.077948 25370 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:47:09.217291 25376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:09.217056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:50819)
0809 18:47:09.217187 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:09.217234 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":65,"threads_started":1}
I20260809 18:47:09.217281 25377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:09.217031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:47413)
0809 18:47:09.217201 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:09.217233 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":93,"threads_started":1}
I20260809 18:47:09.217494 25378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:09.217223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:56829)
0809 18:47:09.217369 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:09.217455 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":62,"threads_started":1}
I20260809 18:47:10.217973 25380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:10.217731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:58751)
0809 18:47:10.217862 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:10.217911 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":69,"threads_started":1}
I20260809 18:47:10.217990 25379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:10.217731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:50347)
0809 18:47:10.217893 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:10.217926 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":73,"threads_started":1}
I20260809 18:47:10.218154 25385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:10.217864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:41247)
0809 18:47:10.218024 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:10.218109 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":94,"threads_started":1}
I20260809 18:47:11.218696 25386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:11.218439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:46681)
0809 18:47:11.218590 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:11.218627 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":73,"threads_started":1}
I20260809 18:47:11.218694 25387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:11.218434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:48053)
0809 18:47:11.218589 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:11.218637 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":74,"threads_started":1}
I20260809 18:47:11.218851 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:11.218599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:53563)
0809 18:47:11.218734 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:11.218772 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":67,"threads_started":1}
I20260809 18:47:12.219444 25390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:12.219179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:53183)
0809 18:47:12.219334 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:12.219379 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":73,"threads_started":1}
I20260809 18:47:12.219446 25389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:12.219179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:50947)
0809 18:47:12.219359 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:12.219399 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":75,"threads_started":1}
I20260809 18:47:12.219448 25392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:12.219240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:48935)
0809 18:47:12.219380 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:12.219414 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":81,"threads_started":1}
I20260809 18:47:13.034267 25393 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 38c653ab2b3049afbdfe338bd9aeddbe)
I20260809 18:47:13.034395 25393 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: false } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } }
I20260809 18:47:13.034586 25393 leader_election.cc:288] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38c653ab2b3049afbdfe338bd9aeddbe (127.12.202.254:42525)
I20260809 18:47:13.034924 25394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:13.034724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:35704)
0809 18:47:13.034845 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:13.034885 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":65,"threads_started":1}
W20260809 18:47:13.035046 24093 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111) [suppressed 1 similar messages]
I20260809 18:47:13.035384 25394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:13.035278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:35720)
0809 18:47:13.035336 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:13.035364 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 18:47:13.035470 24093 leader_election.cc:334] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 38c653ab2b3049afbdfe338bd9aeddbe (127.12.202.254:42525): Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
I20260809 18:47:13.035547 24093 leader_election.cc:302] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 28393c9c23b84c1593caa876aa7c6696; no voters: 38c653ab2b3049afbdfe338bd9aeddbe
I20260809 18:47:13.035642 25393 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:47:13.220151 25400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:13.219930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:50165)
0809 18:47:13.220083 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:13.220115 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":82,"threads_started":1}
I20260809 18:47:13.220151 25398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:13.219922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:43317)
0809 18:47:13.220049 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:13.220093 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":78,"threads_started":1}
I20260809 18:47:13.220173 25401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:13.219995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:49695)
0809 18:47:13.220089 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:13.220132 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77,"thread_start_us":49,"threads_started":1}
I20260809 18:47:14.220891 25409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:14.220665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:42017)
0809 18:47:14.220796 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:14.220839 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":51,"threads_started":1}
I20260809 18:47:14.220891 25402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:14.220627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:56683)
0809 18:47:14.220797 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:14.220837 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":83,"threads_started":1}
I20260809 18:47:14.220891 25404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:14.220658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:34021)
0809 18:47:14.220799 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:14.220837 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":77,"threads_started":1}
I20260809 18:47:15.221560 25410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:15.221292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:32899)
0809 18:47:15.221451 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:15.221499 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":73,"threads_started":1}
I20260809 18:47:15.221560 25411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:15.221292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:43875)
0809 18:47:15.221445 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:15.221504 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":76,"threads_started":1}
I20260809 18:47:15.221590 25414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:15.221386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:57765)
0809 18:47:15.221516 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:15.221548 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":67,"threads_started":1}
I20260809 18:47:16.222265 25418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:16.222016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:48775)
0809 18:47:16.222164 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:16.222213 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":91,"threads_started":1}
I20260809 18:47:16.222265 25417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:16.222007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:57827)
0809 18:47:16.222188 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:16.222219 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":106,"threads_started":1}
I20260809 18:47:16.222479 25416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:16.222007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:41541)
0809 18:47:16.222407 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:16.222440 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":104,"threads_started":1}
I20260809 18:47:17.222965 25420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:17.222659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:39113)
0809 18:47:17.222845 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:17.222918 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":80,"threads_started":1}
I20260809 18:47:17.222967 25419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:17.222659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:58993)
0809 18:47:17.222852 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:17.222908 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":78,"threads_started":1}
I20260809 18:47:17.223179 25421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:17.222948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:52653)
0809 18:47:17.223048 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:17.223136 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":51,"threads_started":1}
I20260809 18:47:18.223573 25423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:18.223373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:41141)
0809 18:47:18.223493 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:18.223528 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":62,"threads_started":1}
I20260809 18:47:18.223608 25422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:18.223359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:48121)
0809 18:47:18.223514 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:18.223552 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":77,"threads_started":1}
I20260809 18:47:18.223706 25424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:18.223537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:46239)
0809 18:47:18.223636 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:18.223665 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":46,"threads_started":1}
I20260809 18:47:18.939321 25425 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 38c653ab2b3049afbdfe338bd9aeddbe)
I20260809 18:47:18.939428 25425 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "38c653ab2b3049afbdfe338bd9aeddbe" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42525 } } peers { permanent_uuid: "28393c9c23b84c1593caa876aa7c6696" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 41855 } attrs { promote: false } } peers { permanent_uuid: "ea851c3bc0544c89b0f7e86930b7e1a5" member_type: NON_VOTER last_known_addr { host: "127.12.202.252" port: 35433 } attrs { promote: true } }
I20260809 18:47:18.939615 25425 leader_election.cc:288] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38c653ab2b3049afbdfe338bd9aeddbe (127.12.202.254:42525)
I20260809 18:47:18.939953 25426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:18.939767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:35956)
0809 18:47:18.939862 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:18.939902 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76,"thread_start_us":53,"threads_started":1}
W20260809 18:47:18.940062 24093 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
I20260809 18:47:18.940513 25426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:18.940401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.0.0.1:35958)
0809 18:47:18.940449 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:18.940483 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 18:47:18.940680 24093 leader_election.cc:334] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 38c653ab2b3049afbdfe338bd9aeddbe (127.12.202.254:42525): Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
I20260809 18:47:18.940768 24093 leader_election.cc:302] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 28393c9c23b84c1593caa876aa7c6696; no voters: 38c653ab2b3049afbdfe338bd9aeddbe
I20260809 18:47:18.940872 25425 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 28393c9c23b84c1593caa876aa7c6696 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:47:19.224274 25428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:19.224034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:45405)
0809 18:47:19.224167 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:19.224207 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":66,"threads_started":1}
I20260809 18:47:19.224274 25430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:19.224031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:54577)
0809 18:47:19.224182 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:19.224220 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":83,"threads_started":1}
I20260809 18:47:19.224408 25431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:19.224190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:43499)
0809 18:47:19.224295 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:19.224366 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":53,"threads_started":1}
I20260809 18:47:20.225023 25433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:20.224750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:58597)
0809 18:47:20.224935 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:20.224969 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":109,"threads_started":1}
I20260809 18:47:20.225023 25432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:20.224759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:40211)
0809 18:47:20.224921 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:20.224969 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":82,"threads_started":1}
I20260809 18:47:20.225235 25436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:20.224759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:44011)
0809 18:47:20.225078 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:20.225184 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":95,"threads_started":1}
I20260809 18:47:21.225840 25437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:21.225601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:42009)
0809 18:47:21.225742 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:21.225784 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":66,"threads_started":1}
I20260809 18:47:21.225840 25440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:21.225623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:60989)
0809 18:47:21.225742 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:21.225785 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":65,"threads_started":1}
I20260809 18:47:21.226027 25438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:21.225595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:52563)
0809 18:47:21.225914 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:21.225957 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":67,"threads_started":1}
I20260809 18:47:22.226711 25446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:22.226515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:52743)
0809 18:47:22.226634 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:22.226660 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":61,"threads_started":1}
I20260809 18:47:22.226711 25445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:22.226465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:48765)
0809 18:47:22.226607 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:22.226656 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":49,"threads_started":1}
I20260809 18:47:22.226753 25443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:22.226364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:46495)
0809 18:47:22.226656 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:22.226699 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":91,"threads_started":1}
I20260809 18:47:23.227487 25452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:23.227257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:44777)
0809 18:47:23.227379 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:23.227420 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
I20260809 18:47:23.227488 25451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:23.227182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:39043)
0809 18:47:23.227363 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:23.227410 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":46,"threads_started":1}
I20260809 18:47:23.227591 25448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:23.227125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:33077)
0809 18:47:23.227493 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:23.227530 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":77,"threads_started":1}
I20260809 18:47:24.228153 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:24.227913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:50217)
0809 18:47:24.228053 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:24.228095 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":72,"threads_started":1}
I20260809 18:47:24.228614 25454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:24.227961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:58829)
0809 18:47:24.228519 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:24.228563 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":71,"threads_started":1}
I20260809 18:47:24.228683 25455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:24.228078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:47087)
0809 18:47:24.228586 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:24.228632 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":58,"threads_started":1}
I20260809 18:47:25.229202 25457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:25.228936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:47605)
0809 18:47:25.229090 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:25.229142 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":68,"threads_started":1}
I20260809 18:47:25.229724 25462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:25.229076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:51505)
0809 18:47:25.229559 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:25.229597 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":70,"threads_started":1}
I20260809 18:47:25.229765 25464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:25.229409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:34047)
0809 18:47:25.229688 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:25.229723 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":71,"threads_started":1}
I20260809 18:47:26.230396 25465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:26.229831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:52699)
0809 18:47:26.230269 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:26.230324 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":81,"threads_started":1}
I20260809 18:47:26.230778 25468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:26.230533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:33057)
0809 18:47:26.230665 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:26.230726 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":66,"threads_started":1}
I20260809 18:47:26.230784 25466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:26.230180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:51615)
0809 18:47:26.230640 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:26.230688 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":66,"threads_started":1}
I20260809 18:47:27.231253 25469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:27.230935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.193:58745)
0809 18:47:27.231084 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:27.231130 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":78,"threads_started":1}
I20260809 18:47:27.231546 25471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:27.231282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.195:52255)
0809 18:47:27.231416 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:27.231451 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":75,"threads_started":1}
I20260809 18:47:27.231734 25472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:27.231558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42525 (local address 127.12.202.194:60957)
0809 18:47:27.231662 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:27.231692 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:42525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":50,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:903: Failure
Failed
Bad status: Timed out: Could not connect to the cluster: ConnectToClusterRpc(addrs: 127.12.202.254:42525,127.12.202.253:41855,127.12.202.252:35433, num_attempts: 243) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.12.202.254:42525,127.12.202.253:41855,127.12.202.252:35433, num_attempts: 1)
I20260809 18:47:27.428491 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 24364
I20260809 18:47:27.441642 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 24746
I20260809 18:47:27.459184 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 24978
I20260809 18:47:27.467000 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 23883
I20260809 18:47:27.477113 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 24206
2026-08-09T18:47:27Z chronyd exiting
I20260809 18:47:27.500005 13099 test_util.cc:175] -----------------------------------------------
I20260809 18:47:27.500058 13099 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786301184679835-13099-0
[ FAILED ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (33433 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:47:27 dist-test-slave-45dx krb5kdc[25476](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:47:27 dist-test-slave-45dx krb5kdc[25476](info): set up 2 sockets
Aug 09 18:47:27 dist-test-slave-45dx krb5kdc[25476](info): commencing operation
krb5kdc: starting...
W20260809 18:47:28.725014 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:47:28 dist-test-slave-45dx krb5kdc[25476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:47:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:47:28Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.254.keytab.
Entry for principal oryx/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.254.keytab.
I20260809 18:47:28.846979 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:43239
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.254.keytab
--principal=oryx/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:45833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:43239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:47:28.927964 25497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:28.928207 25497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:28.928246 25497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:28.929435 25497 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:47:28.929499 25497 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 18:47:28.929522 25497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:28.929554 25497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:28.929600 25497 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:47:28.929629 25497 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:47:28.931167 25497 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:45833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:43239
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.254.keytab
--principal=oryx/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:43239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:28.931459 25497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:28.931682 25497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:28.936995 25504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:28.937003 25503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:28.936997 25510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:28.937014 25497 server_base.cc:1034] running on GCE node
I20260809 18:47:28.937680 25497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:28.938002 25497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:28.939193 25497 hybrid_clock.cc:648] HybridClock initialized: now 1786301248939168 us; error 38 us; skew 500 ppm
Aug 09 18:47:28 dist-test-slave-45dx krb5kdc[25476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301248, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:47:28.941846 25497 init.cc:377] Logged in from keytab as oryx/127.12.202.254@KRBTEST.COM (short username oryx)
I20260809 18:47:28.942409 25497 webserver.cc:460] Webserver started at http://127.12.202.254:46813/ using document root <none> and password file <none>
I20260809 18:47:28.942756 25497 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:28.942839 25497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:28.943002 25497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:28.944098 25497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "09ab9561edcb4f199a7650fb70ffb908"
format_stamp: "Formatted at 2026-08-09 18:47:28 on dist-test-slave-45dx"
server_key: "847a316c2eef13b5ba51a97f25888c3d"
server_key_iv: "81efc5c57fbcd5463b54af469a03d71a"
server_key_version: "encryptionkey@0"
I20260809 18:47:28.944501 25497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "09ab9561edcb4f199a7650fb70ffb908"
format_stamp: "Formatted at 2026-08-09 18:47:28 on dist-test-slave-45dx"
server_key: "847a316c2eef13b5ba51a97f25888c3d"
server_key_iv: "81efc5c57fbcd5463b54af469a03d71a"
server_key_version: "encryptionkey@0"
I20260809 18:47:28.945892 25497 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:47:28.946576 25518 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:28.946744 25497 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:47:28.946847 25497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "09ab9561edcb4f199a7650fb70ffb908"
format_stamp: "Formatted at 2026-08-09 18:47:28 on dist-test-slave-45dx"
server_key: "847a316c2eef13b5ba51a97f25888c3d"
server_key_iv: "81efc5c57fbcd5463b54af469a03d71a"
server_key_version: "encryptionkey@0"
I20260809 18:47:28.946926 25497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:28.962669 25497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:28.964876 25497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:28.965065 25497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:28.970052 25497 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:43239
I20260809 18:47:28.970096 25618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:43239 every 8 connection(s)
I20260809 18:47:28.970428 25497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:47:28.971105 25619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:28.972213 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 25497
I20260809 18:47:28.972378 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:47:28.972582 13099 external_mini_cluster.cc:1428] Setting key ae501b4604c5399f907b83550fa2a617
I20260809 18:47:28.973771 25619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908: Bootstrap starting.
I20260809 18:47:28.974588 25619 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:28.974952 25619 log.cc:824] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908: Log is configured to *not* fsync() on all Append() calls
I20260809 18:47:28.975726 25619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908: No bootstrap required, opened a new log
I20260809 18:47:28.978156 25619 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09ab9561edcb4f199a7650fb70ffb908" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43239 } }
I20260809 18:47:28.978313 25619 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:28.978338 25619 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09ab9561edcb4f199a7650fb70ffb908, State: Initialized, Role: FOLLOWER
I20260809 18:47:28.978482 25619 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09ab9561edcb4f199a7650fb70ffb908" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43239 } }
I20260809 18:47:28.978562 25619 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:47:28.978585 25619 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:47:28.978652 25619 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:28.979197 25619 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09ab9561edcb4f199a7650fb70ffb908" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43239 } }
I20260809 18:47:28.979319 25619 leader_election.cc:302] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09ab9561edcb4f199a7650fb70ffb908; no voters:
I20260809 18:47:28.979552 25619 leader_election.cc:288] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:47:28.979579 25624 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:47:28.979723 25624 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908 [term 1 LEADER]: Becoming Leader. State: Replica: 09ab9561edcb4f199a7650fb70ffb908, State: Running, Role: LEADER
Aug 09 18:47:28 dist-test-slave-45dx krb5kdc[25476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM
I20260809 18:47:28.979897 25624 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09ab9561edcb4f199a7650fb70ffb908" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43239 } }
I20260809 18:47:28.980027 25619 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:47:28.980243 25624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09ab9561edcb4f199a7650fb70ffb908. Latest consensus state: current_term: 1 leader_uuid: "09ab9561edcb4f199a7650fb70ffb908" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09ab9561edcb4f199a7650fb70ffb908" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43239 } } }
I20260809 18:47:28.980435 25624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908 [sys.catalog]: This master's current role is: LEADER
I20260809 18:47:28.981372 25630 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:47:28.981801 25626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09ab9561edcb4f199a7650fb70ffb908" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09ab9561edcb4f199a7650fb70ffb908" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43239 } } }
I20260809 18:47:28.981905 25626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908 [sys.catalog]: This master's current role is: LEADER
I20260809 18:47:28.982304 25630 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:47:28.983959 25630 catalog_manager.cc:1347] Generated new cluster ID: 0aa1054f4cf4463e9f0c0e23e18145d5
I20260809 18:47:28.984009 25630 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:47:28.984251 25622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:28.973125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59716 (local address 127.12.202.254:43239)
0809 18:47:28.973324 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:28.973333 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:28.973369 (+ 36us) server_negotiation.cc:407] Connection header received
0809 18:47:28.973756 (+ 387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:28.973762 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:28.973813 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:28.973975 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:28.974834 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:28.976079 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:28.976851 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:28.977471 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:28.977598 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:28.980524 (+ 2926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:28.980529 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:28.980529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:28.980542 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:28.982597 (+ 2055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:28.982997 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:28.983000 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:28.983001 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:28.983102 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:28.983307 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:28.983307 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:28.983308 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:28.983638 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:28.983806 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:28.983904 (+ 98us) server_negotiation.cc:299] Negotiation successful
0809 18:47:28.984046 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":82,"threads_started":1}
I20260809 18:47:28.999150 25630 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:47:28.999699 25630 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:47:29.008432 25630 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908: Generated new TSK 0
I20260809 18:47:29.008641 25630 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.193.keytab.
Entry for principal oryx/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.193.keytab.
I20260809 18:47:29.040167 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:43239
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.193.keytab
--principal=oryx/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:45833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:47:29.123145 25656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:29.123334 25656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:29.123358 25656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:29.124481 25656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:29.124514 25656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:29.124533 25656 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:47:29.124549 25656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:47:29.126003 25656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:45833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.193.keytab
--principal=oryx/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.202.254:43239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:29.126194 25656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:29.126362 25656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:29.131541 25663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:29.131592 25665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:29.131661 25656 server_base.cc:1034] running on GCE node
W20260809 18:47:29.131541 25662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:29.132045 25656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:29.132285 25656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:29.133519 25656 hybrid_clock.cc:648] HybridClock initialized: now 1786301249133507 us; error 29 us; skew 500 ppm
Aug 09 18:47:29 dist-test-slave-45dx krb5kdc[25476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301249, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:47:29.135975 25656 init.cc:377] Logged in from keytab as oryx/127.12.202.193@KRBTEST.COM (short username oryx)
I20260809 18:47:29.136446 25656 webserver.cc:460] Webserver started at http://127.12.202.193:44355/ using document root <none> and password file <none>
I20260809 18:47:29.136684 25656 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:29.136750 25656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:29.136904 25656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:29.137878 25656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "d62ac9c04fd0461ba97a909d1a644b01"
format_stamp: "Formatted at 2026-08-09 18:47:29 on dist-test-slave-45dx"
server_key: "df721b085b4d76d94cb0fdfa323b079d"
server_key_iv: "0dab4812a26ee090f53dc86f262c8dba"
server_key_version: "encryptionkey@0"
I20260809 18:47:29.138238 25656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "d62ac9c04fd0461ba97a909d1a644b01"
format_stamp: "Formatted at 2026-08-09 18:47:29 on dist-test-slave-45dx"
server_key: "df721b085b4d76d94cb0fdfa323b079d"
server_key_iv: "0dab4812a26ee090f53dc86f262c8dba"
server_key_version: "encryptionkey@0"
I20260809 18:47:29.139523 25656 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 18:47:29.140208 25679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:29.140398 25656 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:29.140486 25656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "d62ac9c04fd0461ba97a909d1a644b01"
format_stamp: "Formatted at 2026-08-09 18:47:29 on dist-test-slave-45dx"
server_key: "df721b085b4d76d94cb0fdfa323b079d"
server_key_iv: "0dab4812a26ee090f53dc86f262c8dba"
server_key_version: "encryptionkey@0"
I20260809 18:47:29.140569 25656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:29.153257 25656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:29.155048 25656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:29.155206 25656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:29.155692 25656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:47:29.155756 25656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:29.155799 25656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:47:29.155821 25656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:29.162703 25656 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:36573
Aug 09 18:47:29 dist-test-slave-45dx krb5kdc[25476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301249, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM
I20260809 18:47:29.162770 25857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:36573 every 8 connection(s)
I20260809 18:47:29.163138 25656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:47:29.165541 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 25656
I20260809 18:47:29.165689 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:47:29.165980 13099 external_mini_cluster.cc:1428] Setting key f558312271675cf3669ad7d018112db7
I20260809 18:47:29.166841 25622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.156164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:59429 (local address 127.12.202.254:43239)
0809 18:47:29.156212 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:29.156214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:29.156495 (+ 281us) server_negotiation.cc:407] Connection header received
0809 18:47:29.156971 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:29.156973 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:29.156988 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:29.157065 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:29.157661 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.158512 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.160176 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.160559 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.160640 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.163379 (+ 2739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:29.163382 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:29.163382 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:29.163392 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:29.165327 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:29.165727 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:29.165728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:29.165729 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:29.165825 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:29.166134 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:29.166135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:29.166135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:29.166250 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:29.166303 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:29.166658 (+ 355us) server_negotiation.cc:299] Negotiation successful
0809 18:47:29.166761 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 18:47:29.167126 25694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.156157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43239 (local address 127.12.202.193:59429)
0809 18:47:29.156333 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:29.156401 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:29.156876 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:29.157159 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:29.157162 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:29.157393 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:29.157582 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.157586 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.158632 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.158633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.160075 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.160078 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.160664 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.160665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.160836 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.161396 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:29.161407 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:29.163282 (+ 1875us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:29.165416 (+ 2134us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:29.165421 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:29.165423 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:29.165633 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:29.165926 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:29.165927 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:29.165927 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:29.166051 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:29.166309 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:29.166317 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:29.166481 (+ 164us) client_negotiation.cc:769] Sending connection context
0809 18:47:29.166621 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 18:47:29.166834 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":83,"threads_started":1}
I20260809 18:47:29.168982 25859 heartbeater.cc:347] Connected to a master server at 127.12.202.254:43239
I20260809 18:47:29.169103 25859 heartbeater.cc:464] Registering TS with master...
I20260809 18:47:29.169291 25859 heartbeater.cc:511] Master 127.12.202.254:43239 requested a full tablet report, sending...
I20260809 18:47:29.169899 25541 ts_manager.cc:194] Registered new tserver with Master: d62ac9c04fd0461ba97a909d1a644b01 (127.12.202.193:36573)
I20260809 18:47:29.170863 25541 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:59429
WARNING: no policy specified for oryx/127.12.202.194@KRBTEST.COM; defaulting to no policy
I20260809 18:47:29.175515 25622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.168898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:40533 (local address 127.12.202.254:43239)
0809 18:47:29.168994 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:29.168996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:29.169004 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:47:29.169023 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:29.169024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:29.169035 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:29.169083 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:29.169579 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.170317 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.171465 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.171688 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.171776 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.172821 (+ 1045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:29.172823 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:29.172823 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:29.172830 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:29.174259 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:29.174662 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:29.174663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:29.174663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:29.174724 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:29.174954 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:29.174955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:29.174956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:29.175077 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:29.175158 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:29.175337 (+ 179us) server_negotiation.cc:299] Negotiation successful
0809 18:47:29.175419 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 18:47:29.175534 25882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.168619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43239 (local address 127.12.202.193:40533)
0809 18:47:29.168772 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:29.168784 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:29.168840 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:29.169124 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:29.169125 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:29.169350 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:29.169429 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.169430 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.170440 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.170441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.171372 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.171375 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.171777 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.171777 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.171853 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.172379 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:29.172385 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:29.172703 (+ 318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:29.174369 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:29.174371 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:29.174371 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:29.174566 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:29.174807 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:29.174808 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:29.174808 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:29.174882 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:29.175163 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:29.175164 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:29.175213 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 18:47:29.175308 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 18:47:29.175418 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":79,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.194.keytab.
Entry for principal oryx/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.194.keytab.
I20260809 18:47:29.195235 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:43239
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.194.keytab
--principal=oryx/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:45833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:47:29.277120 25887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:29.277318 25887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:29.277343 25887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:29.278478 25887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:29.278522 25887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:29.278542 25887 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:47:29.278601 25887 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:47:29.280210 25887 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:45833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.194.keytab
--principal=oryx/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.202.254:43239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:29.280493 25887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:29.280750 25887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:29.286094 25902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:29.286083 25897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:29.286101 25887 server_base.cc:1034] running on GCE node
W20260809 18:47:29.286064 25895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:29.286463 25887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:29.286696 25887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:29.287869 25887 hybrid_clock.cc:648] HybridClock initialized: now 1786301249287854 us; error 44 us; skew 500 ppm
Aug 09 18:47:29 dist-test-slave-45dx krb5kdc[25476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301249, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:47:29.290566 25887 init.cc:377] Logged in from keytab as oryx/127.12.202.194@KRBTEST.COM (short username oryx)
I20260809 18:47:29.291013 25887 webserver.cc:460] Webserver started at http://127.12.202.194:44719/ using document root <none> and password file <none>
I20260809 18:47:29.291265 25887 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:29.291311 25887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:29.291486 25887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:29.292585 25887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "b5cdbfe088a344e5bcad5949a91f2008"
format_stamp: "Formatted at 2026-08-09 18:47:29 on dist-test-slave-45dx"
server_key: "1320980011627eb8bbac0d5b4305662a"
server_key_iv: "5d15d10107f55359c026097f18eaed9c"
server_key_version: "encryptionkey@0"
I20260809 18:47:29.292929 25887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "b5cdbfe088a344e5bcad5949a91f2008"
format_stamp: "Formatted at 2026-08-09 18:47:29 on dist-test-slave-45dx"
server_key: "1320980011627eb8bbac0d5b4305662a"
server_key_iv: "5d15d10107f55359c026097f18eaed9c"
server_key_version: "encryptionkey@0"
I20260809 18:47:29.294229 25887 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:47:29.294956 25914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:29.295150 25887 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:47:29.295236 25887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "b5cdbfe088a344e5bcad5949a91f2008"
format_stamp: "Formatted at 2026-08-09 18:47:29 on dist-test-slave-45dx"
server_key: "1320980011627eb8bbac0d5b4305662a"
server_key_iv: "5d15d10107f55359c026097f18eaed9c"
server_key_version: "encryptionkey@0"
I20260809 18:47:29.295290 25887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:29.307479 25887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:29.309265 25887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:29.309370 25887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:29.309783 25887 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:47:29.309820 25887 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:29.309841 25887 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:47:29.309854 25887 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:29.317188 25887 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:37503
Aug 09 18:47:29 dist-test-slave-45dx krb5kdc[25476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301249, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM
I20260809 18:47:29.317270 26094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:37503 every 8 connection(s)
I20260809 18:47:29.317579 25887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:47:29.320225 25622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.310289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:41557 (local address 127.12.202.254:43239)
0809 18:47:29.310330 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:29.310332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:29.310588 (+ 256us) server_negotiation.cc:407] Connection header received
0809 18:47:29.311103 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:29.311105 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:29.311119 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:29.311207 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:29.312165 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.313038 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.314670 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.315031 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.315111 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.317801 (+ 2690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:29.317802 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:29.317803 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:29.317811 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:29.319060 (+ 1249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:29.319423 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:29.319424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:29.319424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:29.319474 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:29.319676 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:29.319677 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:29.319677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:29.319774 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:29.319842 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:29.320100 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 18:47:29.320163 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 18:47:29.320423 25927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.310286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43239 (local address 127.12.202.194:41557)
0809 18:47:29.310457 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:29.310507 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:29.310986 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:29.311331 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:29.311336 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:29.311731 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:29.312040 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.312047 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.313162 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.313163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.314558 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.314562 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.315125 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.315126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.315283 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.315883 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:29.315894 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:29.317700 (+ 1806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:29.319132 (+ 1432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:29.319138 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:29.319140 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:29.319350 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:29.319529 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:29.319530 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:29.319530 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:29.319625 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:29.319870 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:29.319875 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:29.319980 (+ 105us) client_negotiation.cc:769] Sending connection context
0809 18:47:29.320072 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 18:47:29.320185 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":84,"threads_started":1}
I20260809 18:47:29.320561 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 25887
I20260809 18:47:29.320677 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:47:29.320915 13099 external_mini_cluster.cc:1428] Setting key 390ab22a3b48549291862771692f4c00
I20260809 18:47:29.320982 26095 heartbeater.cc:347] Connected to a master server at 127.12.202.254:43239
I20260809 18:47:29.321076 26095 heartbeater.cc:464] Registering TS with master...
I20260809 18:47:29.321283 26095 heartbeater.cc:511] Master 127.12.202.254:43239 requested a full tablet report, sending...
I20260809 18:47:29.321725 25542 ts_manager.cc:194] Registered new tserver with Master: b5cdbfe088a344e5bcad5949a91f2008 (127.12.202.194:37503)
I20260809 18:47:29.322235 25542 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:41557
I20260809 18:47:29.328454 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.322020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43239 (local address 127.12.202.194:47877)
0809 18:47:29.322411 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:29.322422 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:29.322478 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:29.322587 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:29.322588 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:29.322802 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:29.322881 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.322883 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.323554 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.323556 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.324181 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.324182 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.324671 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.324672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.324723 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.325164 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:29.325175 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:29.325454 (+ 279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:29.327255 (+ 1801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:29.327256 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:29.327256 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:29.327427 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:29.327653 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:29.327653 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:29.327653 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:29.327734 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:29.328109 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:29.328109 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:29.328147 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 18:47:29.328203 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 18:47:29.328281 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":71,"threads_started":1}
I20260809 18:47:29.328547 25622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.322091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:47877 (local address 127.12.202.254:43239)
0809 18:47:29.322131 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:29.322133 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:29.322493 (+ 360us) server_negotiation.cc:407] Connection header received
0809 18:47:29.322520 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:29.322521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:29.322531 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:29.322581 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:29.322970 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.323438 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.324261 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.324587 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.324654 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.325543 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:29.325544 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:29.325545 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:29.325552 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:29.327167 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:29.327513 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:29.327515 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:29.327515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:29.327581 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:29.327812 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:29.327813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:29.327813 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:29.328029 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:29.328112 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:29.328260 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 18:47:29.328389 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
WARNING: no policy specified for oryx/127.12.202.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.195.keytab.
Entry for principal oryx/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.195.keytab.
I20260809 18:47:29.348825 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:43239
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.195.keytab
--principal=oryx/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:45833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:47:29.429618 26106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:29.429798 26106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:29.429821 26106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:29.430938 26106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:29.430979 26106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:29.430997 26106 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 18:47:29.431054 26106 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:47:29.432607 26106 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:45833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.195.keytab
--principal=oryx/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.202.254:43239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26106
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:29.432842 26106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:29.433082 26106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:29.438022 26122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:29.438015 26125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:29.438015 26120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:29.438233 26106 server_base.cc:1034] running on GCE node
I20260809 18:47:29.438459 26106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:29.438649 26106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:29.439821 26106 hybrid_clock.cc:648] HybridClock initialized: now 1786301249439800 us; error 32 us; skew 500 ppm
Aug 09 18:47:29 dist-test-slave-45dx krb5kdc[25476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301249, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:47:29.442431 26106 init.cc:377] Logged in from keytab as oryx/127.12.202.195@KRBTEST.COM (short username oryx)
I20260809 18:47:29.442862 26106 webserver.cc:460] Webserver started at http://127.12.202.195:35765/ using document root <none> and password file <none>
I20260809 18:47:29.443055 26106 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:29.443095 26106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:29.443184 26106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:29.444240 26106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "561e33c64548493baa0e43c401d0f814"
format_stamp: "Formatted at 2026-08-09 18:47:29 on dist-test-slave-45dx"
server_key: "77f40b5e88ddc0ea417b94b5e41837ed"
server_key_iv: "de29484bdba79ab6842c6a717a46c84c"
server_key_version: "encryptionkey@0"
I20260809 18:47:29.444610 26106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "561e33c64548493baa0e43c401d0f814"
format_stamp: "Formatted at 2026-08-09 18:47:29 on dist-test-slave-45dx"
server_key: "77f40b5e88ddc0ea417b94b5e41837ed"
server_key_iv: "de29484bdba79ab6842c6a717a46c84c"
server_key_version: "encryptionkey@0"
I20260809 18:47:29.445811 26106 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:47:29.446468 26135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:29.446645 26106 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:47:29.446785 26106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "561e33c64548493baa0e43c401d0f814"
format_stamp: "Formatted at 2026-08-09 18:47:29 on dist-test-slave-45dx"
server_key: "77f40b5e88ddc0ea417b94b5e41837ed"
server_key_iv: "de29484bdba79ab6842c6a717a46c84c"
server_key_version: "encryptionkey@0"
I20260809 18:47:29.446864 26106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:29.464211 26106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:29.466485 26106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:29.466635 26106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:29.467128 26106 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:47:29.467195 26106 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:29.467227 26106 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:47:29.467255 26106 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:29.474422 26106 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:46819
Aug 09 18:47:29 dist-test-slave-45dx krb5kdc[25476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301249, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM
I20260809 18:47:29.474526 26328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:46819 every 8 connection(s)
I20260809 18:47:29.474792 26106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:47:29.477818 25622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.467600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:58025 (local address 127.12.202.254:43239)
0809 18:47:29.467652 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:29.467655 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:29.467872 (+ 217us) server_negotiation.cc:407] Connection header received
0809 18:47:29.468608 (+ 736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:29.468609 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:29.468622 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:29.468673 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:29.469576 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.470340 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.471927 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.472256 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.472412 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.474965 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:29.474967 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:29.474967 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:29.474975 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:29.476427 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:29.476957 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:29.476958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:29.476958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:29.477019 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:29.477282 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:29.477282 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:29.477282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:29.477402 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:29.477472 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:29.477672 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 18:47:29.477733 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 18:47:29.477957 26152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.467552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43239 (local address 127.12.202.195:58025)
0809 18:47:29.467746 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:29.467793 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:29.468494 (+ 701us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:29.468761 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:29.468765 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:29.469176 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:29.469475 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.469483 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.470446 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.470447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.471826 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.471830 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.472434 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.472435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.472571 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.473067 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:29.473078 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:29.474853 (+ 1775us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:29.476497 (+ 1644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:29.476503 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:29.476504 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:29.476712 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:29.477090 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:29.477091 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:29.477091 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:29.477202 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:29.477475 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:29.477479 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:29.477583 (+ 104us) client_negotiation.cc:769] Sending connection context
0809 18:47:29.477660 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 18:47:29.477775 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":78,"threads_started":1}
I20260809 18:47:29.478500 26331 heartbeater.cc:347] Connected to a master server at 127.12.202.254:43239
I20260809 18:47:29.478582 26331 heartbeater.cc:464] Registering TS with master...
I20260809 18:47:29.478758 26331 heartbeater.cc:511] Master 127.12.202.254:43239 requested a full tablet report, sending...
I20260809 18:47:29.479179 25542 ts_manager.cc:194] Registered new tserver with Master: 561e33c64548493baa0e43c401d0f814 (127.12.202.195:46819)
I20260809 18:47:29.479656 25542 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:58025
I20260809 18:47:29.483858 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 26106
I20260809 18:47:29.483958 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:47:29.484177 13099 external_mini_cluster.cc:1428] Setting key 5dde2174a2f7eac06b51be9fce321dc7
I20260809 18:47:29.484912 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:47:29.485253 25622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.479632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:36705 (local address 127.12.202.254:43239)
0809 18:47:29.479676 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:29.479678 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:29.479740 (+ 62us) server_negotiation.cc:407] Connection header received
0809 18:47:29.479808 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:29.479809 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:29.479820 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:29.479878 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:29.480266 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.480969 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.481889 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.482063 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.482115 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.482990 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:29.482991 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:29.482991 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:29.482996 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:29.484125 (+ 1129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:29.484539 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:29.484540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:29.484540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:29.484590 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:29.484792 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:29.484793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:29.484793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:29.484893 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:29.484963 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:29.485106 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 18:47:29.485173 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 18:47:29.485267 26339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.479550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43239 (local address 127.12.202.195:36705)
0809 18:47:29.479688 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:29.479698 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:29.479755 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:29.479893 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:29.479893 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:29.480117 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:29.480182 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.480184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.481048 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.481051 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.481812 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.481816 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.482128 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.482128 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.482176 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.482629 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:29.482634 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:29.482908 (+ 274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:29.484218 (+ 1310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:29.484219 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:29.484220 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:29.484455 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:29.484662 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:29.484662 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:29.484663 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:29.484725 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:29.484956 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:29.484957 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:29.485000 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 18:47:29.485082 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 18:47:29.485175 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":81,"threads_started":1}
Aug 09 18:47:29 dist-test-slave-45dx krb5kdc[25476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301249, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 18:47:29 dist-test-slave-45dx krb5kdc[25476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:29 dist-test-slave-45dx krb5kdc[25476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 18:47:29.506853 25622 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:29.501755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59724 (local address 127.12.202.254:43239)
0809 18:47:29.501837 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:29.501838 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:29.501847 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:47:29.501905 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:29.501906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:29.501915 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:29.501972 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:29.502495 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.502981 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.503668 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.503849 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.503895 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.506759 (+ 2864us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59724: BlockingRecv error: recv got EOF from 127.0.0.1:59724 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 09 18:47:29 dist-test-slave-45dx krb5kdc[25476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301249, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM
I20260809 18:47:29.513779 25622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.507697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59740 (local address 127.12.202.254:43239)
0809 18:47:29.507753 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:29.507755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:29.507862 (+ 107us) server_negotiation.cc:407] Connection header received
0809 18:47:29.507896 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:29.507897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:29.507906 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:29.507950 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:29.508424 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.508956 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.509560 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.509720 (+ 160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.509765 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.511676 (+ 1911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:29.511677 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:29.511677 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:29.511683 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:29.512912 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:29.513197 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:29.513198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:29.513198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:29.513246 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:29.513407 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:29.513408 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:29.513408 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:29.513493 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:29.513562 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:29.513643 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 18:47:29.513694 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 18:47:29.515357 25542 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59740:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:47:29.517468 25542 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:47:29.524245 26379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.520018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:36573 (local address 127.0.0.1:35502)
0809 18:47:29.520403 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:29.520413 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:29.520463 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:29.520977 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:29.520978 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:29.520980 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:47:29.521014 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.521016 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.522243 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.522244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.523302 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.523304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.523956 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.523957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.524033 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.524045 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 18:47:29.524115 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 18:47:29.524165 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":78,"threads_started":1}
I20260809 18:47:29.524453 26378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.519948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49242 (local address 127.12.202.195:46819)
0809 18:47:29.520162 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:29.520167 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:29.520419 (+ 252us) server_negotiation.cc:407] Connection header received
0809 18:47:29.520496 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:29.520499 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:29.520528 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:29.520618 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:47:29.520834 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.521990 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.523159 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.523882 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.523979 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.524029 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:29.524246 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 18:47:29.524289 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":108,"threads_started":1}
I20260809 18:47:29.524468 26374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.519795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:37503 (local address 127.0.0.1:50060)
0809 18:47:29.520132 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:29.520172 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:29.520234 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:29.520755 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:29.520757 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:29.520759 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:47:29.520815 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.520817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.521917 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.521918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.523272 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.523275 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.524232 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.524233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.524284 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.524287 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:47:29.524354 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 18:47:29.524395 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":72,"threads_started":1}
I20260809 18:47:29.524641 26375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.519832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:46819 (local address 127.0.0.1:49242)
0809 18:47:29.520354 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:29.520363 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:29.520416 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:29.520634 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:29.520636 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:29.520638 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:47:29.520686 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.520687 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.522105 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.522106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.523053 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.523055 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.524075 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.524076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.524150 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.524153 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:47:29.524541 (+ 388us) client_negotiation.cc:240] Negotiation successful
0809 18:47:29.524585 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":82,"threads_started":1}
I20260809 18:47:29.524266 26380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.520156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35502 (local address 127.12.202.193:36573)
0809 18:47:29.520345 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:29.520349 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:29.520748 (+ 399us) server_negotiation.cc:407] Connection header received
0809 18:47:29.520796 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:29.520798 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:29.520813 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:29.520908 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:47:29.521100 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.522166 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.523386 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.523859 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.523962 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.524025 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:29.524129 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 18:47:29.524170 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":109,"threads_started":1}
I20260809 18:47:29.524770 26377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.519941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50060 (local address 127.12.202.194:37503)
0809 18:47:29.520435 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:29.520439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:29.520510 (+ 71us) server_negotiation.cc:407] Connection header received
0809 18:47:29.520562 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:29.520564 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:29.520579 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:29.520675 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:47:29.520976 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.521814 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.523362 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.524059 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.524151 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.524200 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:29.524615 (+ 415us) server_negotiation.cc:299] Negotiation successful
0809 18:47:29.524656 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":85,"threads_started":1}
I20260809 18:47:29.525298 26221 tablet_service.cc:1467] Processing CreateTablet for tablet 0a7c901078874251a6968e53f664114a (DEFAULT_TABLE table=test-table [id=0b67fb6ddf1f45a880f05816ad8ead09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:47:29.525393 25752 tablet_service.cc:1467] Processing CreateTablet for tablet 0a7c901078874251a6968e53f664114a (DEFAULT_TABLE table=test-table [id=0b67fb6ddf1f45a880f05816ad8ead09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:47:29.525393 25998 tablet_service.cc:1467] Processing CreateTablet for tablet 0a7c901078874251a6968e53f664114a (DEFAULT_TABLE table=test-table [id=0b67fb6ddf1f45a880f05816ad8ead09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:47:29.525647 26221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a7c901078874251a6968e53f664114a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:29.525717 25998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a7c901078874251a6968e53f664114a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:29.525717 25752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a7c901078874251a6968e53f664114a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:29.528436 26381 tablet_bootstrap.cc:492] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814: Bootstrap starting.
I20260809 18:47:29.529035 26381 tablet_bootstrap.cc:654] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:29.529337 26381 log.cc:824] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814: Log is configured to *not* fsync() on all Append() calls
I20260809 18:47:29.529590 26386 tablet_bootstrap.cc:492] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01: Bootstrap starting.
I20260809 18:47:29.530153 26381 tablet_bootstrap.cc:492] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814: No bootstrap required, opened a new log
I20260809 18:47:29.530211 26381 ts_tablet_manager.cc:1397] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:47:29.530275 26386 tablet_bootstrap.cc:654] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:29.530567 26386 log.cc:824] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01: Log is configured to *not* fsync() on all Append() calls
I20260809 18:47:29.530913 26383 tablet_bootstrap.cc:492] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008: Bootstrap starting.
I20260809 18:47:29.531256 26386 tablet_bootstrap.cc:492] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01: No bootstrap required, opened a new log
I20260809 18:47:29.531309 26386 ts_tablet_manager.cc:1397] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:47:29.531821 26381 raft_consensus.cc:348] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } }
I20260809 18:47:29.531976 26381 raft_consensus.cc:374] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:29.532023 26381 raft_consensus.cc:729] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561e33c64548493baa0e43c401d0f814, State: Initialized, Role: FOLLOWER
I20260809 18:47:29.532166 26381 consensus_queue.cc:260] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } }
I20260809 18:47:29.532477 26381 ts_tablet_manager.cc:1428] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 18:47:29.532618 26331 heartbeater.cc:503] Master 127.12.202.254:43239 was elected leader, sending a full tablet report...
I20260809 18:47:29.532991 26383 tablet_bootstrap.cc:654] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:29.533162 26386 raft_consensus.cc:348] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } }
I20260809 18:47:29.533274 26383 log.cc:824] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008: Log is configured to *not* fsync() on all Append() calls
I20260809 18:47:29.533313 26386 raft_consensus.cc:374] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:29.533354 26386 raft_consensus.cc:729] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62ac9c04fd0461ba97a909d1a644b01, State: Initialized, Role: FOLLOWER
I20260809 18:47:29.533478 26386 consensus_queue.cc:260] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } }
I20260809 18:47:29.533735 26386 ts_tablet_manager.cc:1428] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 18:47:29.533769 25859 heartbeater.cc:503] Master 127.12.202.254:43239 was elected leader, sending a full tablet report...
I20260809 18:47:29.534350 26383 tablet_bootstrap.cc:492] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008: No bootstrap required, opened a new log
I20260809 18:47:29.534420 26383 ts_tablet_manager.cc:1397] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260809 18:47:29.535887 26383 raft_consensus.cc:348] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } }
I20260809 18:47:29.536027 26383 raft_consensus.cc:374] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:29.536077 26383 raft_consensus.cc:729] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5cdbfe088a344e5bcad5949a91f2008, State: Initialized, Role: FOLLOWER
I20260809 18:47:29.536181 26383 consensus_queue.cc:260] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } }
I20260809 18:47:29.536448 26383 ts_tablet_manager.cc:1428] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 18:47:29.536509 26095 heartbeater.cc:503] Master 127.12.202.254:43239 was elected leader, sending a full tablet report...
W20260809 18:47:29.568502 26096 tablet.cc:2369] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:47:29.650199 26393 raft_consensus.cc:482] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:47:29.650414 26393 raft_consensus.cc:504] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } }
I20260809 18:47:29.650864 26393 leader_election.cc:288] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5cdbfe088a344e5bcad5949a91f2008 (127.12.202.194:37503), 561e33c64548493baa0e43c401d0f814 (127.12.202.195:46819)
I20260809 18:47:29.654898 26378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.651219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:46187 (local address 127.12.202.195:46819)
0809 18:47:29.651270 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:29.651273 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:29.651310 (+ 37us) server_negotiation.cc:407] Connection header received
0809 18:47:29.651359 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:29.651360 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:29.651371 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:29.651422 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:47:29.651609 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.652440 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.653972 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.654517 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.654595 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.654603 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:29.654786 (+ 183us) server_negotiation.cc:299] Negotiation successful
0809 18:47:29.654825 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 18:47:29.654903 26377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.651257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:47705 (local address 127.12.202.194:37503)
0809 18:47:29.651379 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:29.651381 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:29.651496 (+ 115us) server_negotiation.cc:407] Connection header received
0809 18:47:29.651527 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:29.651528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:29.651535 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:29.651610 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:47:29.651738 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.652477 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.653974 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.654518 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.654595 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.654603 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:29.654789 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 18:47:29.654826 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 18:47:29.654920 26395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.651093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:37503 (local address 127.12.202.193:47705)
0809 18:47:29.651407 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:29.651417 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:29.651473 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:29.651614 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:29.651615 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:29.651616 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:47:29.651671 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.651672 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.652555 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.652556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.653877 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.653878 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.654611 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.654612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.654705 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.654709 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:47:29.654767 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 18:47:29.654813 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"mutex_wait_us":194,"thread_start_us":131,"threads_started":1}
I20260809 18:47:29.654920 25694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.651091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:46819 (local address 127.12.202.193:46187)
0809 18:47:29.651186 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:29.651199 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:29.651267 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:29.651445 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:29.651446 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:29.651448 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:47:29.651532 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.651534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.652555 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.652556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.653873 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.653877 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.654611 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.654612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.654709 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.654711 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:47:29.654767 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 18:47:29.654813 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68,"mutex_wait_us":83}
I20260809 18:47:29.655339 26028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a7c901078874251a6968e53f664114a" candidate_uuid: "d62ac9c04fd0461ba97a909d1a644b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5cdbfe088a344e5bcad5949a91f2008" is_pre_election: true
I20260809 18:47:29.655534 26028 raft_consensus.cc:2454] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62ac9c04fd0461ba97a909d1a644b01 in term 0.
I20260809 18:47:29.655679 26250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a7c901078874251a6968e53f664114a" candidate_uuid: "d62ac9c04fd0461ba97a909d1a644b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561e33c64548493baa0e43c401d0f814" is_pre_election: true
I20260809 18:47:29.655809 25681 leader_election.cc:302] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5cdbfe088a344e5bcad5949a91f2008, d62ac9c04fd0461ba97a909d1a644b01; no voters:
I20260809 18:47:29.655869 26250 raft_consensus.cc:2454] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62ac9c04fd0461ba97a909d1a644b01 in term 0.
I20260809 18:47:29.655951 26393 raft_consensus.cc:2781] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:47:29.656049 26393 raft_consensus.cc:482] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:47:29.656086 26393 raft_consensus.cc:3037] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:29.656821 26393 raft_consensus.cc:504] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } }
I20260809 18:47:29.656956 26393 leader_election.cc:288] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [CANDIDATE]: Term 1 election: Requested vote from peers b5cdbfe088a344e5bcad5949a91f2008 (127.12.202.194:37503), 561e33c64548493baa0e43c401d0f814 (127.12.202.195:46819)
I20260809 18:47:29.657131 26028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a7c901078874251a6968e53f664114a" candidate_uuid: "d62ac9c04fd0461ba97a909d1a644b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5cdbfe088a344e5bcad5949a91f2008"
I20260809 18:47:29.657135 26250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a7c901078874251a6968e53f664114a" candidate_uuid: "d62ac9c04fd0461ba97a909d1a644b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561e33c64548493baa0e43c401d0f814"
I20260809 18:47:29.657200 26028 raft_consensus.cc:3037] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:29.657234 26250 raft_consensus.cc:3037] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:29.657945 26250 raft_consensus.cc:2454] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62ac9c04fd0461ba97a909d1a644b01 in term 1.
I20260809 18:47:29.657949 26028 raft_consensus.cc:2454] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62ac9c04fd0461ba97a909d1a644b01 in term 1.
I20260809 18:47:29.658138 25681 leader_election.cc:302] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5cdbfe088a344e5bcad5949a91f2008, d62ac9c04fd0461ba97a909d1a644b01; no voters:
I20260809 18:47:29.658243 26393 raft_consensus.cc:2781] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:47:29.658427 26393 raft_consensus.cc:686] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [term 1 LEADER]: Becoming Leader. State: Replica: d62ac9c04fd0461ba97a909d1a644b01, State: Running, Role: LEADER
I20260809 18:47:29.658551 26393 consensus_queue.cc:237] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } }
I20260809 18:47:29.659447 25542 catalog_manager.cc:5495] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62ac9c04fd0461ba97a909d1a644b01 (127.12.202.193). New cstate: current_term: 1 leader_uuid: "d62ac9c04fd0461ba97a909d1a644b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } health_report { overall_health: HEALTHY } } }
W20260809 18:47:29.664165 25861 tablet.cc:2369] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:47:29.672744 26380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.670364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35506 (local address 127.12.202.193:36573)
0809 18:47:29.670406 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:29.670409 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:29.670417 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:47:29.670492 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:29.670493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:29.670511 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:29.670591 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:47:29.670719 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.671200 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.671953 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.672161 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.672236 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.672432 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:47:29.672530 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:47:29.672620 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:29.672644 (+ 24us) server_negotiation.cc:299] Negotiation successful
0809 18:47:29.672664 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:47:29.674495 26250 raft_consensus.cc:1261] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814 [term 1 FOLLOWER]: Refusing update from remote peer d62ac9c04fd0461ba97a909d1a644b01: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:47:29.674511 26028 raft_consensus.cc:1261] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008 [term 1 FOLLOWER]: Refusing update from remote peer d62ac9c04fd0461ba97a909d1a644b01: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:47:29.674887 26393 consensus_queue.cc:1035] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:47:29.675067 26396 consensus_queue.cc:1035] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:47:29.677373 26402 mvcc.cc:205] Tried to move back new op lower bound from 7316689918664048640 to 7316689918602203136. Current Snapshot: MvccSnapshot[applied={T|T < 7316689918664048640}]
I20260809 18:47:29.678184 26403 mvcc.cc:205] Tried to move back new op lower bound from 7316689918664048640 to 7316689918602203136. Current Snapshot: MvccSnapshot[applied={T|T < 7316689918664048640}]
I20260809 18:47:29.678467 26404 mvcc.cc:205] Tried to move back new op lower bound from 7316689918664048640 to 7316689918602203136. Current Snapshot: MvccSnapshot[applied={T|T < 7316689918664048640 or (T in {7316689918664048640})}]
I20260809 18:47:29.679767 25542 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:47:29.679863 25542 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:47:29.680691 25542 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908: Sending DeleteTablet for 3 replicas of tablet 0a7c901078874251a6968e53f664114a
I20260809 18:47:29.681120 25752 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a7c901078874251a6968e53f664114a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:47:29 UTC) from {username='oryx', principal='oryx/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:35502
I20260809 18:47:29.681514 25998 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a7c901078874251a6968e53f664114a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:47:29 UTC) from {username='oryx', principal='oryx/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:50060
I20260809 18:47:29.681636 26221 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a7c901078874251a6968e53f664114a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:47:29 UTC) from {username='oryx', principal='oryx/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:49242
I20260809 18:47:29.681756 26414 tablet_replica.cc:330] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01: stopping tablet replica
I20260809 18:47:29.681870 26417 tablet_replica.cc:330] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814: stopping tablet replica
I20260809 18:47:29.681905 26414 raft_consensus.cc:2229] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:47:29.681967 26417 raft_consensus.cc:2229] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:47:29.682027 26414 raft_consensus.cc:2258] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:47:29.682353 26417 raft_consensus.cc:2258] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:47:29.682713 26414 ts_tablet_manager.cc:1905] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:47:29.683174 25542 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59740:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:47:29.683348 25542 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:47:29.683506 26417 ts_tablet_manager.cc:1905] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:47:29.685245 25998 tablet_service.cc:1467] Processing CreateTablet for tablet ea61527b13a14b3fb8d84df090da10a9 (DEFAULT_TABLE table=test-table [id=086ee0dd54b14e3195b00017cbf1ce08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:47:29.685250 25752 tablet_service.cc:1467] Processing CreateTablet for tablet ea61527b13a14b3fb8d84df090da10a9 (DEFAULT_TABLE table=test-table [id=086ee0dd54b14e3195b00017cbf1ce08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:47:29.685386 25998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea61527b13a14b3fb8d84df090da10a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:29.685920 26417 ts_tablet_manager.cc:1918] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:47:29.686014 26417 log.cc:1196] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/0a7c901078874251a6968e53f664114a
I20260809 18:47:29.686332 26417 ts_tablet_manager.cc:1939] T 0a7c901078874251a6968e53f664114a P 561e33c64548493baa0e43c401d0f814: Deleting consensus metadata
I20260809 18:47:29.686754 25524 catalog_manager.cc:4841] TS 561e33c64548493baa0e43c401d0f814 (127.12.202.195:46819): tablet 0a7c901078874251a6968e53f664114a (table test-table [id=0b67fb6ddf1f45a880f05816ad8ead09]) successfully deleted
I20260809 18:47:29.686828 26383 tablet_bootstrap.cc:492] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008: Bootstrap starting.
I20260809 18:47:29.686889 26221 tablet_service.cc:1467] Processing CreateTablet for tablet ea61527b13a14b3fb8d84df090da10a9 (DEFAULT_TABLE table=test-table [id=086ee0dd54b14e3195b00017cbf1ce08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:47:29.686991 26221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea61527b13a14b3fb8d84df090da10a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:29.687207 26383 tablet_bootstrap.cc:654] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:29.687827 26383 tablet_bootstrap.cc:492] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008: No bootstrap required, opened a new log
I20260809 18:47:29.687903 26383 ts_tablet_manager.cc:1397] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 18:47:29.688072 26383 raft_consensus.cc:348] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:29.688171 26383 raft_consensus.cc:374] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:29.688194 26383 raft_consensus.cc:729] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5cdbfe088a344e5bcad5949a91f2008, State: Initialized, Role: FOLLOWER
I20260809 18:47:29.688215 26381 tablet_bootstrap.cc:492] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814: Bootstrap starting.
I20260809 18:47:29.688243 26383 consensus_queue.cc:260] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:29.688370 26383 ts_tablet_manager.cc:1428] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 18:47:29.688521 26415 tablet_replica.cc:330] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008: stopping tablet replica
I20260809 18:47:29.688639 26415 raft_consensus.cc:2229] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:47:29.688684 26381 tablet_bootstrap.cc:654] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:29.688746 26415 raft_consensus.cc:2258] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:47:29.688902 25752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea61527b13a14b3fb8d84df090da10a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:29.689311 26415 ts_tablet_manager.cc:1905] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:47:29.689448 26381 tablet_bootstrap.cc:492] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814: No bootstrap required, opened a new log
I20260809 18:47:29.689498 26381 ts_tablet_manager.cc:1397] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:47:29.689678 26381 raft_consensus.cc:348] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:29.689755 26381 raft_consensus.cc:374] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:29.689785 26381 raft_consensus.cc:729] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561e33c64548493baa0e43c401d0f814, State: Initialized, Role: FOLLOWER
I20260809 18:47:29.689826 26381 consensus_queue.cc:260] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:29.689909 26381 ts_tablet_manager.cc:1428] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 18:47:29.690371 26386 tablet_bootstrap.cc:492] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01: Bootstrap starting.
I20260809 18:47:29.690791 26386 tablet_bootstrap.cc:654] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:29.690886 26415 ts_tablet_manager.cc:1918] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:47:29.690969 26415 log.cc:1196] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/0a7c901078874251a6968e53f664114a
I20260809 18:47:29.691258 26415 ts_tablet_manager.cc:1939] T 0a7c901078874251a6968e53f664114a P b5cdbfe088a344e5bcad5949a91f2008: Deleting consensus metadata
I20260809 18:47:29.691633 26386 tablet_bootstrap.cc:492] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01: No bootstrap required, opened a new log
I20260809 18:47:29.691682 26386 ts_tablet_manager.cc:1397] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:47:29.691673 25520 catalog_manager.cc:4841] TS b5cdbfe088a344e5bcad5949a91f2008 (127.12.202.194:37503): tablet 0a7c901078874251a6968e53f664114a (table test-table [id=0b67fb6ddf1f45a880f05816ad8ead09]) successfully deleted
I20260809 18:47:29.691820 26386 raft_consensus.cc:348] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:29.691903 26386 raft_consensus.cc:374] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:29.691926 26386 raft_consensus.cc:729] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62ac9c04fd0461ba97a909d1a644b01, State: Initialized, Role: FOLLOWER
I20260809 18:47:29.691977 26386 consensus_queue.cc:260] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:29.692063 26386 ts_tablet_manager.cc:1428] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 18:47:29.692978 26414 ts_tablet_manager.cc:1918] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:47:29.693061 26414 log.cc:1196] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/wal/wals/0a7c901078874251a6968e53f664114a
I20260809 18:47:29.693331 26414 ts_tablet_manager.cc:1939] T 0a7c901078874251a6968e53f664114a P d62ac9c04fd0461ba97a909d1a644b01: Deleting consensus metadata
I20260809 18:47:29.693688 26394 raft_consensus.cc:482] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:47:29.693753 26394 raft_consensus.cc:504] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:29.693799 25524 catalog_manager.cc:4841] TS d62ac9c04fd0461ba97a909d1a644b01 (127.12.202.193:36573): tablet 0a7c901078874251a6968e53f664114a (table test-table [id=0b67fb6ddf1f45a880f05816ad8ead09]) successfully deleted
I20260809 18:47:29.694051 26394 leader_election.cc:288] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62ac9c04fd0461ba97a909d1a644b01 (127.12.202.193:36573), 561e33c64548493baa0e43c401d0f814 (127.12.202.195:46819)
I20260809 18:47:29.697737 25927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.694312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:46819 (local address 127.12.202.194:41843)
0809 18:47:29.694475 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:29.694486 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:29.694537 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:29.694704 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:29.694705 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:29.694707 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:47:29.694767 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.694769 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.695416 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.695417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.696643 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.696646 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.697433 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.697434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.697539 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.697544 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:47:29.697602 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 18:47:29.697649 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":52,"threads_started":1}
I20260809 18:47:29.697857 26423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.694222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:36573 (local address 127.12.202.194:33189)
0809 18:47:29.694470 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:29.694482 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:29.694559 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:29.694705 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:29.694706 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:29.694708 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:47:29.694815 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.694816 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.695636 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.695637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.696968 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.696971 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.697585 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.697586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.697668 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.697671 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:47:29.697731 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 18:47:29.697771 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172}
I20260809 18:47:29.697902 26380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.694283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:33189 (local address 127.12.202.193:36573)
0809 18:47:29.694324 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:29.694326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:29.694537 (+ 211us) server_negotiation.cc:407] Connection header received
0809 18:47:29.694636 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:29.694637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:29.694647 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:29.694702 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:47:29.694880 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.695552 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.697052 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.697497 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.697575 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.697585 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:29.697782 (+ 197us) server_negotiation.cc:299] Negotiation successful
0809 18:47:29.697827 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 18:47:29.698345 26378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.694505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:41843 (local address 127.12.202.195:46819)
0809 18:47:29.694546 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:29.694548 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:29.694560 (+ 12us) server_negotiation.cc:407] Connection header received
0809 18:47:29.694598 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:29.694599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:29.694608 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:29.694655 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:47:29.694851 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.695330 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.696739 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.697327 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.697407 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.697418 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:29.698256 (+ 838us) server_negotiation.cc:299] Negotiation successful
0809 18:47:29.698299 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:47:29.698349 25782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea61527b13a14b3fb8d84df090da10a9" candidate_uuid: "b5cdbfe088a344e5bcad5949a91f2008" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62ac9c04fd0461ba97a909d1a644b01" is_pre_election: true
I20260809 18:47:29.698474 25782 raft_consensus.cc:2454] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5cdbfe088a344e5bcad5949a91f2008 in term 0.
I20260809 18:47:29.698559 26250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea61527b13a14b3fb8d84df090da10a9" candidate_uuid: "b5cdbfe088a344e5bcad5949a91f2008" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561e33c64548493baa0e43c401d0f814" is_pre_election: true
I20260809 18:47:29.698643 26250 raft_consensus.cc:2454] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5cdbfe088a344e5bcad5949a91f2008 in term 0.
I20260809 18:47:29.698673 25919 leader_election.cc:302] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5cdbfe088a344e5bcad5949a91f2008, d62ac9c04fd0461ba97a909d1a644b01; no voters:
I20260809 18:47:29.698843 26394 raft_consensus.cc:2781] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:47:29.698882 26394 raft_consensus.cc:482] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:47:29.698904 26394 raft_consensus.cc:3037] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:29.699707 26394 raft_consensus.cc:504] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:29.699839 26394 leader_election.cc:288] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [CANDIDATE]: Term 1 election: Requested vote from peers d62ac9c04fd0461ba97a909d1a644b01 (127.12.202.193:36573), 561e33c64548493baa0e43c401d0f814 (127.12.202.195:46819)
I20260809 18:47:29.700066 26250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea61527b13a14b3fb8d84df090da10a9" candidate_uuid: "b5cdbfe088a344e5bcad5949a91f2008" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561e33c64548493baa0e43c401d0f814"
I20260809 18:47:29.700150 26250 raft_consensus.cc:3037] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:29.700796 26250 raft_consensus.cc:2454] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5cdbfe088a344e5bcad5949a91f2008 in term 1.
I20260809 18:47:29.700968 25919 leader_election.cc:302] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561e33c64548493baa0e43c401d0f814, b5cdbfe088a344e5bcad5949a91f2008; no voters:
I20260809 18:47:29.700966 25782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea61527b13a14b3fb8d84df090da10a9" candidate_uuid: "b5cdbfe088a344e5bcad5949a91f2008" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62ac9c04fd0461ba97a909d1a644b01"
I20260809 18:47:29.701040 25782 raft_consensus.cc:3037] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:29.701092 26394 raft_consensus.cc:2781] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:47:29.701232 26394 raft_consensus.cc:686] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [term 1 LEADER]: Becoming Leader. State: Replica: b5cdbfe088a344e5bcad5949a91f2008, State: Running, Role: LEADER
I20260809 18:47:29.701294 26394 consensus_queue.cc:237] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:29.701946 25782 raft_consensus.cc:2454] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5cdbfe088a344e5bcad5949a91f2008 in term 1.
I20260809 18:47:29.702493 25542 catalog_manager.cc:5495] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5cdbfe088a344e5bcad5949a91f2008 (127.12.202.194). New cstate: current_term: 1 leader_uuid: "b5cdbfe088a344e5bcad5949a91f2008" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } health_report { overall_health: UNKNOWN } } }
W20260809 18:47:29.725397 26332 tablet.cc:2369] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 18:47:29 dist-test-slave-45dx krb5kdc[25476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301248, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.254@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM
I20260809 18:47:29.729434 25622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.721240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59750 (local address 127.12.202.254:43239)
0809 18:47:29.721310 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:29.721313 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:29.721508 (+ 195us) server_negotiation.cc:407] Connection header received
0809 18:47:29.721559 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:29.721559 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:29.721569 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:29.721612 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:29.722241 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.722721 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.723801 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.723990 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.724047 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.726683 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:29.726684 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:29.726685 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:29.726691 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:29.728165 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:29.728605 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:29.728606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:29.728607 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:29.728666 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:29.728865 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:29.728866 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:29.728867 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:29.728976 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:29.729054 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:29.729221 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 18:47:29.729324 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 18:47:29.729517 26436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:29.721194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43239 (local address 127.0.0.1:59750)
0809 18:47:29.721384 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:29.721396 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:29.721489 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:29.721634 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:29.721635 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:29.722073 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:29.722166 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.722168 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.722799 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.722800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.723704 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:29.723706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:29.724071 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:29.724072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:29.724134 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:29.724796 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:29.724802 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:29.726593 (+ 1791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:29.728261 (+ 1668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:29.728269 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:29.728272 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:29.728518 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:29.728737 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:29.728738 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:29.728738 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:29.728801 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:29.729044 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:29.729053 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:29.729100 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 18:47:29.729198 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 18:47:29.729391 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":85,"thread_start_us":118,"threads_started":1}
I20260809 18:47:29.731570 25542 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:59750:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 18:47:29.731782 25542 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:47:29.733258 25752 tablet_service.cc:1467] Processing CreateTablet for tablet c9c87772385a493aa14fc399ee1616e7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5d091dcfc9204f4385e71c291fa61d89]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:47:29.733279 25998 tablet_service.cc:1467] Processing CreateTablet for tablet c9c87772385a493aa14fc399ee1616e7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5d091dcfc9204f4385e71c291fa61d89]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:47:29.733431 25752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9c87772385a493aa14fc399ee1616e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:29.733431 25998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9c87772385a493aa14fc399ee1616e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:29.733389 26221 tablet_service.cc:1467] Processing CreateTablet for tablet c9c87772385a493aa14fc399ee1616e7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5d091dcfc9204f4385e71c291fa61d89]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 18:47:29.733619 26221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9c87772385a493aa14fc399ee1616e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:29.734927 26383 tablet_bootstrap.cc:492] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008: Bootstrap starting.
I20260809 18:47:29.735083 26381 tablet_bootstrap.cc:492] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814: Bootstrap starting.
I20260809 18:47:29.735188 26386 tablet_bootstrap.cc:492] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01: Bootstrap starting.
I20260809 18:47:29.735404 26383 tablet_bootstrap.cc:654] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:29.735512 26381 tablet_bootstrap.cc:654] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:29.735632 26386 tablet_bootstrap.cc:654] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:29.736171 26383 tablet_bootstrap.cc:492] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008: No bootstrap required, opened a new log
I20260809 18:47:29.736171 26381 tablet_bootstrap.cc:492] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814: No bootstrap required, opened a new log
I20260809 18:47:29.736222 26383 ts_tablet_manager.cc:1397] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 18:47:29.736222 26381 ts_tablet_manager.cc:1397] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260809 18:47:29.736402 26383 raft_consensus.cc:348] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:29.736477 26383 raft_consensus.cc:374] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:29.736425 26381 raft_consensus.cc:348] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:29.736497 26383 raft_consensus.cc:729] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5cdbfe088a344e5bcad5949a91f2008, State: Initialized, Role: FOLLOWER
I20260809 18:47:29.736503 26381 raft_consensus.cc:374] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:29.736527 26381 raft_consensus.cc:729] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561e33c64548493baa0e43c401d0f814, State: Initialized, Role: FOLLOWER
I20260809 18:47:29.736544 26383 consensus_queue.cc:260] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:29.736570 26381 consensus_queue.cc:260] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:29.736647 26383 ts_tablet_manager.cc:1428] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 18:47:29.736649 26381 ts_tablet_manager.cc:1428] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 18:47:29.736775 26394 tablet_replica.cc:439] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } }
I20260809 18:47:29.736775 26390 tablet_replica.cc:439] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } }
I20260809 18:47:29.736863 26394 tablet_replica.cc:442] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:47:29.736863 26390 tablet_replica.cc:442] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:47:29.737144 26386 tablet_bootstrap.cc:492] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01: No bootstrap required, opened a new log
I20260809 18:47:29.737192 26386 ts_tablet_manager.cc:1397] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:47:29.737339 26386 raft_consensus.cc:348] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:29.737402 26386 raft_consensus.cc:374] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:29.737421 26386 raft_consensus.cc:729] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62ac9c04fd0461ba97a909d1a644b01, State: Initialized, Role: FOLLOWER
I20260809 18:47:29.737465 26386 consensus_queue.cc:260] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:29.737545 26386 ts_tablet_manager.cc:1428] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:29.737645 26410 tablet_replica.cc:439] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } }
I20260809 18:47:29.737772 26410 tablet_replica.cc:442] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:47:30.067842 26410 raft_consensus.cc:482] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:47:30.067965 26410 raft_consensus.cc:504] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.068137 26410 leader_election.cc:288] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5cdbfe088a344e5bcad5949a91f2008 (127.12.202.194:37503), 561e33c64548493baa0e43c401d0f814 (127.12.202.195:46819)
I20260809 18:47:30.068440 26250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9c87772385a493aa14fc399ee1616e7" candidate_uuid: "d62ac9c04fd0461ba97a909d1a644b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561e33c64548493baa0e43c401d0f814" is_pre_election: true
I20260809 18:47:30.068436 26028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9c87772385a493aa14fc399ee1616e7" candidate_uuid: "d62ac9c04fd0461ba97a909d1a644b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5cdbfe088a344e5bcad5949a91f2008" is_pre_election: true
I20260809 18:47:30.068539 26250 raft_consensus.cc:2454] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62ac9c04fd0461ba97a909d1a644b01 in term 0.
I20260809 18:47:30.068567 26028 raft_consensus.cc:2454] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d62ac9c04fd0461ba97a909d1a644b01 in term 0.
I20260809 18:47:30.068740 25681 leader_election.cc:302] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5cdbfe088a344e5bcad5949a91f2008, d62ac9c04fd0461ba97a909d1a644b01; no voters:
I20260809 18:47:30.068840 26410 raft_consensus.cc:2781] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:47:30.068887 26410 raft_consensus.cc:482] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:47:30.068915 26410 raft_consensus.cc:3037] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:30.069676 26410 raft_consensus.cc:504] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.069820 26410 leader_election.cc:288] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [CANDIDATE]: Term 1 election: Requested vote from peers b5cdbfe088a344e5bcad5949a91f2008 (127.12.202.194:37503), 561e33c64548493baa0e43c401d0f814 (127.12.202.195:46819)
I20260809 18:47:30.069979 26028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9c87772385a493aa14fc399ee1616e7" candidate_uuid: "d62ac9c04fd0461ba97a909d1a644b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5cdbfe088a344e5bcad5949a91f2008"
I20260809 18:47:30.070080 26028 raft_consensus.cc:3037] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:30.070034 26250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9c87772385a493aa14fc399ee1616e7" candidate_uuid: "d62ac9c04fd0461ba97a909d1a644b01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561e33c64548493baa0e43c401d0f814"
I20260809 18:47:30.070123 26250 raft_consensus.cc:3037] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:30.070731 26250 raft_consensus.cc:2454] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62ac9c04fd0461ba97a909d1a644b01 in term 1.
I20260809 18:47:30.070856 26028 raft_consensus.cc:2454] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d62ac9c04fd0461ba97a909d1a644b01 in term 1.
I20260809 18:47:30.070976 25684 leader_election.cc:302] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561e33c64548493baa0e43c401d0f814, d62ac9c04fd0461ba97a909d1a644b01; no voters:
I20260809 18:47:30.071096 26410 raft_consensus.cc:2781] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:47:30.071210 26410 raft_consensus.cc:686] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [term 1 LEADER]: Becoming Leader. State: Replica: d62ac9c04fd0461ba97a909d1a644b01, State: Running, Role: LEADER
I20260809 18:47:30.071269 26410 consensus_queue.cc:237] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.071534 26396 tablet_replica.cc:439] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01: TxnStatusTablet state changed. Reason: New leader d62ac9c04fd0461ba97a909d1a644b01. Latest consensus state: current_term: 1 leader_uuid: "d62ac9c04fd0461ba97a909d1a644b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } }
I20260809 18:47:30.071630 26396 tablet_replica.cc:442] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:47:30.071861 26442 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 18:47:30.071991 26442 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 18:47:30.071913 25541 catalog_manager.cc:5495] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 reported cstate change: term changed from 0 to 1, leader changed from <none> to d62ac9c04fd0461ba97a909d1a644b01 (127.12.202.193). New cstate: current_term: 1 leader_uuid: "d62ac9c04fd0461ba97a909d1a644b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } health_report { overall_health: UNKNOWN } } }
I20260809 18:47:30.093982 26436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:30.091538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:36573 (local address 127.0.0.1:35518)
0809 18:47:30.091616 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:30.091631 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:30.091707 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:30.091860 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:30.091860 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:30.091862 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:47:30.091926 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:30.091928 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.092637 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.092638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:30.093178 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:30.093180 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.093520 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.093521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:30.093588 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:30.093601 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:47:30.093806 (+ 205us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:47:30.093816 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 18:47:30.093855 (+ 39us) client_negotiation.cc:240] Negotiation successful
0809 18:47:30.093916 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 18:47:30.093963 26380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:30.091631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35518 (local address 127.12.202.193:36573)
0809 18:47:30.091694 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:30.091696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:30.091706 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:47:30.091788 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:30.091789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:30.091800 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:30.091852 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:47:30.091997 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.092546 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.093272 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.093452 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.093518 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:30.093688 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:47:30.093739 (+ 51us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:47:30.093793 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:30.093867 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 18:47:30.093888 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 18:47:30.095108 26028 raft_consensus.cc:1261] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008 [term 1 FOLLOWER]: Refusing update from remote peer d62ac9c04fd0461ba97a909d1a644b01: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:47:30.095180 26250 raft_consensus.cc:1261] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814 [term 1 FOLLOWER]: Refusing update from remote peer d62ac9c04fd0461ba97a909d1a644b01: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:47:30.095359 26410 consensus_queue.cc:1035] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:47:30.095449 26396 consensus_queue.cc:1035] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:47:30.095896 26394 tablet_replica.cc:439] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008: TxnStatusTablet state changed. Reason: New leader d62ac9c04fd0461ba97a909d1a644b01. Latest consensus state: current_term: 1 leader_uuid: "d62ac9c04fd0461ba97a909d1a644b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } }
I20260809 18:47:30.096010 26394 tablet_replica.cc:442] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:47:30.095945 26390 tablet_replica.cc:439] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814: TxnStatusTablet state changed. Reason: New leader d62ac9c04fd0461ba97a909d1a644b01. Latest consensus state: current_term: 1 leader_uuid: "d62ac9c04fd0461ba97a909d1a644b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } }
I20260809 18:47:30.096045 26390 tablet_replica.cc:442] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:47:30.096854 26410 tablet_replica.cc:439] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d62ac9c04fd0461ba97a909d1a644b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } }
I20260809 18:47:30.096949 26410 tablet_replica.cc:442] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:47:30.097047 26410 tablet_replica.cc:439] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d62ac9c04fd0461ba97a909d1a644b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } }
I20260809 18:47:30.097110 26410 tablet_replica.cc:442] T c9c87772385a493aa14fc399ee1616e7 P d62ac9c04fd0461ba97a909d1a644b01: This TxnStatusTablet replica's current role is: LEADER
I20260809 18:47:30.097078 26394 tablet_replica.cc:439] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d62ac9c04fd0461ba97a909d1a644b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } }
I20260809 18:47:30.097157 26394 tablet_replica.cc:442] T c9c87772385a493aa14fc399ee1616e7 P b5cdbfe088a344e5bcad5949a91f2008: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:47:30.098181 26390 tablet_replica.cc:439] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d62ac9c04fd0461ba97a909d1a644b01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } } }
I20260809 18:47:30.098270 26390 tablet_replica.cc:442] T c9c87772385a493aa14fc399ee1616e7 P 561e33c64548493baa0e43c401d0f814: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 18:47:30.101058 26377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:30.098773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50074 (local address 127.12.202.194:37503)
0809 18:47:30.098814 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:30.098816 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:30.098823 (+ 7us) server_negotiation.cc:407] Connection header received
0809 18:47:30.098861 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:30.098862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:30.098880 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:30.098960 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:47:30.099069 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.099506 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.100198 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.100471 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.100554 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:30.100724 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:47:30.100832 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:47:30.100914 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:30.100964 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 18:47:30.100985 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:47:30.106112 26380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:30.103436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:47615 (local address 127.12.202.193:36573)
0809 18:47:30.103480 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:30.103481 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:30.103627 (+ 146us) server_negotiation.cc:407] Connection header received
0809 18:47:30.103677 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:30.103677 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:30.103686 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:30.103724 (+ 38us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:47:30.103839 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.104235 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.105335 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.105525 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.105574 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:30.105808 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:47:30.105832 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:47:30.105935 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:30.106003 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 18:47:30.106040 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:47:30.106127 26451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:30.103379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:36573 (local address 127.12.202.194:47615)
0809 18:47:30.103552 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:30.103562 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:30.103622 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:30.103736 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:30.103736 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:30.103738 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:47:30.103787 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:30.103788 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.104318 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.104319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:30.105257 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:30.105260 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.105629 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.105630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:30.105711 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:30.105727 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:47:30.105941 (+ 214us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:47:30.105944 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:47:30.105998 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 18:47:30.106046 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":93,"threads_started":1}
I20260809 18:47:30.108273 26250 raft_consensus.cc:1261] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814 [term 1 FOLLOWER]: Refusing update from remote peer b5cdbfe088a344e5bcad5949a91f2008: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:47:30.108388 25782 raft_consensus.cc:1261] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01 [term 1 FOLLOWER]: Refusing update from remote peer b5cdbfe088a344e5bcad5949a91f2008: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:47:30.108553 26424 consensus_queue.cc:1035] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:47:30.108655 26394 consensus_queue.cc:1035] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:47:30.117288 26377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:30.114793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:51573 (local address 127.12.202.194:37503)
0809 18:47:30.114832 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:30.114833 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:30.115002 (+ 169us) server_negotiation.cc:407] Connection header received
0809 18:47:30.115064 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:30.115065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:30.115076 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:30.115130 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:47:30.115232 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.115658 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.116455 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.116662 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.116693 (+ 31us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:30.117029 (+ 336us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:47:30.117060 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:47:30.117106 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:30.117207 (+ 101us) server_negotiation.cc:299] Negotiation successful
0809 18:47:30.117226 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 18:47:30.117317 26460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:30.114752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:37503 (local address 127.12.202.193:51573)
0809 18:47:30.114947 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:30.114959 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:30.115017 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:30.115133 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:30.115134 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:30.115135 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 18:47:30.115187 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:30.115188 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.115740 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.115742 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:30.116310 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:30.116331 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.116837 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.116839 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:30.116895 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:30.116928 (+ 33us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 18:47:30.117130 (+ 202us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 18:47:30.117132 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:47:30.117197 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 18:47:30.117244 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":82,"threads_started":1}
I20260809 18:47:30.130709 25541 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:47:30.130821 25541 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:47:30.131466 25541 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908: Sending DeleteTablet for 3 replicas of tablet ea61527b13a14b3fb8d84df090da10a9
I20260809 18:47:30.131729 25752 tablet_service.cc:1514] Processing DeleteTablet for tablet ea61527b13a14b3fb8d84df090da10a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:47:30 UTC) from {username='oryx', principal='oryx/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:35502
I20260809 18:47:30.131754 26221 tablet_service.cc:1514] Processing DeleteTablet for tablet ea61527b13a14b3fb8d84df090da10a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:47:30 UTC) from {username='oryx', principal='oryx/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:49242
I20260809 18:47:30.131857 26414 tablet_replica.cc:330] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01: stopping tablet replica
I20260809 18:47:30.131870 26417 tablet_replica.cc:330] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814: stopping tablet replica
I20260809 18:47:30.131924 26417 raft_consensus.cc:2229] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:47:30.131925 26414 raft_consensus.cc:2229] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:47:30.131969 26414 raft_consensus.cc:2258] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:47:30.131969 26417 raft_consensus.cc:2258] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:47:30.132233 26414 ts_tablet_manager.cc:1905] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:47:30.132280 25998 tablet_service.cc:1514] Processing DeleteTablet for tablet ea61527b13a14b3fb8d84df090da10a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:47:30 UTC) from {username='oryx', principal='oryx/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:50060
I20260809 18:47:30.132321 26417 ts_tablet_manager.cc:1905] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:47:30.132375 26415 tablet_replica.cc:330] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008: stopping tablet replica
I20260809 18:47:30.132444 26415 raft_consensus.cc:2229] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:47:30.132524 26415 raft_consensus.cc:2258] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:47:30.132792 26415 ts_tablet_manager.cc:1905] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:47:30.134331 26417 ts_tablet_manager.cc:1918] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:47:30.134394 26417 log.cc:1196] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/ea61527b13a14b3fb8d84df090da10a9
I20260809 18:47:30.134442 26415 ts_tablet_manager.cc:1918] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:47:30.134493 26415 log.cc:1196] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/ea61527b13a14b3fb8d84df090da10a9
I20260809 18:47:30.134624 26417 ts_tablet_manager.cc:1939] T ea61527b13a14b3fb8d84df090da10a9 P 561e33c64548493baa0e43c401d0f814: Deleting consensus metadata
I20260809 18:47:30.134703 26415 ts_tablet_manager.cc:1939] T ea61527b13a14b3fb8d84df090da10a9 P b5cdbfe088a344e5bcad5949a91f2008: Deleting consensus metadata
I20260809 18:47:30.134965 25524 catalog_manager.cc:4841] TS 561e33c64548493baa0e43c401d0f814 (127.12.202.195:46819): tablet ea61527b13a14b3fb8d84df090da10a9 (table test-table [id=086ee0dd54b14e3195b00017cbf1ce08]) successfully deleted
I20260809 18:47:30.135190 26414 ts_tablet_manager.cc:1918] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:47:30.135249 26414 log.cc:1196] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/wal/wals/ea61527b13a14b3fb8d84df090da10a9
I20260809 18:47:30.135509 26414 ts_tablet_manager.cc:1939] T ea61527b13a14b3fb8d84df090da10a9 P d62ac9c04fd0461ba97a909d1a644b01: Deleting consensus metadata
I20260809 18:47:30.135826 25524 catalog_manager.cc:4841] TS d62ac9c04fd0461ba97a909d1a644b01 (127.12.202.193:36573): tablet ea61527b13a14b3fb8d84df090da10a9 (table test-table [id=086ee0dd54b14e3195b00017cbf1ce08]) successfully deleted
I20260809 18:47:30.139387 25520 catalog_manager.cc:4841] TS b5cdbfe088a344e5bcad5949a91f2008 (127.12.202.194:37503): tablet ea61527b13a14b3fb8d84df090da10a9 (table test-table [id=086ee0dd54b14e3195b00017cbf1ce08]) successfully deleted
Aug 09 18:47:30 dist-test-slave-45dx krb5kdc[25476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301250, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 18:47:30 dist-test-slave-45dx krb5kdc[25476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:30 dist-test-slave-45dx krb5kdc[25476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
W20260809 18:47:30.160060 25622 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:30.154646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59766 (local address 127.12.202.254:43239)
0809 18:47:30.154694 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:30.154696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:30.154841 (+ 145us) server_negotiation.cc:407] Connection header received
0809 18:47:30.154921 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:30.154922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:30.154933 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:30.155003 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:30.155665 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.156150 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.157033 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.157233 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.157308 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:30.160015 (+ 2707us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59766: BlockingRecv error: recv got EOF from 127.0.0.1:59766 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 09 18:47:30 dist-test-slave-45dx krb5kdc[25476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301250, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM
I20260809 18:47:30.169044 25622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:30.161138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59772 (local address 127.12.202.254:43239)
0809 18:47:30.161177 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:30.161179 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:30.161390 (+ 211us) server_negotiation.cc:407] Connection header received
0809 18:47:30.161463 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:30.161464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:30.161473 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:30.161529 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:30.161993 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.162453 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.163159 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.163361 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.163453 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:30.165880 (+ 2427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:30.165881 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:30.165882 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:30.165890 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:30.167663 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:30.168085 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:30.168087 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:30.168087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:30.168150 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:30.168428 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:30.168429 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:30.168430 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:30.168564 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:30.168659 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:30.168868 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 18:47:30.168957 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:47:30.170662 25541 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59772:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:47:30.170864 25541 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:47:30.172444 26221 tablet_service.cc:1467] Processing CreateTablet for tablet 5dad5fadd8324b65990e277722bcc7c7 (DEFAULT_TABLE table=test-table [id=6f58c12a1027405f91e37619f362fa24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:47:30.172605 26221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5dad5fadd8324b65990e277722bcc7c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:30.173974 26381 tablet_bootstrap.cc:492] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814: Bootstrap starting.
I20260809 18:47:30.173988 25752 tablet_service.cc:1467] Processing CreateTablet for tablet 5dad5fadd8324b65990e277722bcc7c7 (DEFAULT_TABLE table=test-table [id=6f58c12a1027405f91e37619f362fa24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:47:30.174103 25752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5dad5fadd8324b65990e277722bcc7c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:30.174407 26381 tablet_bootstrap.cc:654] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:30.175410 26381 tablet_bootstrap.cc:492] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814: No bootstrap required, opened a new log
I20260809 18:47:30.175457 26381 ts_tablet_manager.cc:1397] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 18:47:30.175467 25998 tablet_service.cc:1467] Processing CreateTablet for tablet 5dad5fadd8324b65990e277722bcc7c7 (DEFAULT_TABLE table=test-table [id=6f58c12a1027405f91e37619f362fa24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:47:30.175586 25998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5dad5fadd8324b65990e277722bcc7c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:30.175606 26381 raft_consensus.cc:348] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.175675 26381 raft_consensus.cc:374] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:30.175695 26381 raft_consensus.cc:729] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561e33c64548493baa0e43c401d0f814, State: Initialized, Role: FOLLOWER
I20260809 18:47:30.175740 26381 consensus_queue.cc:260] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.175819 26381 ts_tablet_manager.cc:1428] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 18:47:30.176391 26386 tablet_bootstrap.cc:492] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01: Bootstrap starting.
I20260809 18:47:30.176676 26386 tablet_bootstrap.cc:654] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:30.177839 26383 tablet_bootstrap.cc:492] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008: Bootstrap starting.
I20260809 18:47:30.178282 26383 tablet_bootstrap.cc:654] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:30.179041 26383 tablet_bootstrap.cc:492] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008: No bootstrap required, opened a new log
I20260809 18:47:30.179098 26383 ts_tablet_manager.cc:1397] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 18:47:30.179252 26383 raft_consensus.cc:348] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.179337 26383 raft_consensus.cc:374] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:30.179359 26383 raft_consensus.cc:729] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5cdbfe088a344e5bcad5949a91f2008, State: Initialized, Role: FOLLOWER
I20260809 18:47:30.179426 26383 consensus_queue.cc:260] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.179518 26383 ts_tablet_manager.cc:1428] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:30.180725 26386 tablet_bootstrap.cc:492] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01: No bootstrap required, opened a new log
I20260809 18:47:30.180784 26386 ts_tablet_manager.cc:1397] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260809 18:47:30.180929 26386 raft_consensus.cc:348] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.181010 26386 raft_consensus.cc:374] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:30.181038 26386 raft_consensus.cc:729] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62ac9c04fd0461ba97a909d1a644b01, State: Initialized, Role: FOLLOWER
I20260809 18:47:30.181083 26386 consensus_queue.cc:260] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.181185 26386 ts_tablet_manager.cc:1428] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 18:47:30.220175 26390 raft_consensus.cc:482] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:47:30.220306 26390 raft_consensus.cc:504] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.220705 26390 leader_election.cc:288] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62ac9c04fd0461ba97a909d1a644b01 (127.12.202.193:36573), b5cdbfe088a344e5bcad5949a91f2008 (127.12.202.194:37503)
I20260809 18:47:30.223846 26377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:30.221056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:55483 (local address 127.12.202.194:37503)
0809 18:47:30.221122 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:30.221125 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:30.221224 (+ 99us) server_negotiation.cc:407] Connection header received
0809 18:47:30.221278 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:30.221279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:30.221290 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:30.221343 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:47:30.221497 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.222044 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.223070 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.223426 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.223512 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:30.223523 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:30.223734 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 18:47:30.223776 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:47:30.224013 26495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:30.220869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:37503 (local address 127.12.202.195:55483)
0809 18:47:30.221137 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:30.221149 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:30.221212 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:30.221345 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:30.221345 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:30.221347 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:47:30.221415 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:30.221416 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.222183 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.222184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:30.222955 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:30.222957 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.223513 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.223514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:30.223581 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:30.223584 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:47:30.223692 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 18:47:30.223735 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":92,"threads_started":1}
I20260809 18:47:30.224277 26028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5dad5fadd8324b65990e277722bcc7c7" candidate_uuid: "561e33c64548493baa0e43c401d0f814" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5cdbfe088a344e5bcad5949a91f2008" is_pre_election: true
I20260809 18:47:30.224431 26028 raft_consensus.cc:2454] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561e33c64548493baa0e43c401d0f814 in term 0.
I20260809 18:47:30.224659 26380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:30.220914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:52943 (local address 127.12.202.193:36573)
0809 18:47:30.221020 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:30.221023 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:30.221201 (+ 178us) server_negotiation.cc:407] Connection header received
0809 18:47:30.221322 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:30.221324 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:30.221336 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:30.221390 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:47:30.221629 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.222320 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.223650 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.224204 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.224271 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:30.224280 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:30.224556 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 18:47:30.224595 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 18:47:30.224646 26136 leader_election.cc:302] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561e33c64548493baa0e43c401d0f814, b5cdbfe088a344e5bcad5949a91f2008; no voters:
I20260809 18:47:30.224787 26390 raft_consensus.cc:2781] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:47:30.224821 26390 raft_consensus.cc:482] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:47:30.224839 26390 raft_consensus.cc:3037] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:30.225049 26498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:30.220860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:36573 (local address 127.12.202.195:52943)
0809 18:47:30.221133 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:30.221145 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:30.221218 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:30.221439 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:30.221440 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:30.221442 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:47:30.221513 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:30.221515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.222452 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.222452 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:30.223547 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:30.223551 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.224366 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.224367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:30.224445 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:30.224449 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:47:30.224787 (+ 338us) client_negotiation.cc:240] Negotiation successful
0809 18:47:30.224831 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":110,"threads_started":1}
I20260809 18:47:30.225306 25782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5dad5fadd8324b65990e277722bcc7c7" candidate_uuid: "561e33c64548493baa0e43c401d0f814" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62ac9c04fd0461ba97a909d1a644b01" is_pre_election: true
I20260809 18:47:30.225409 25782 raft_consensus.cc:2454] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561e33c64548493baa0e43c401d0f814 in term 0.
I20260809 18:47:30.225800 26390 raft_consensus.cc:504] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.225951 26390 leader_election.cc:288] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [CANDIDATE]: Term 1 election: Requested vote from peers d62ac9c04fd0461ba97a909d1a644b01 (127.12.202.193:36573), b5cdbfe088a344e5bcad5949a91f2008 (127.12.202.194:37503)
I20260809 18:47:30.226133 26028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5dad5fadd8324b65990e277722bcc7c7" candidate_uuid: "561e33c64548493baa0e43c401d0f814" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5cdbfe088a344e5bcad5949a91f2008"
I20260809 18:47:30.226137 25782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5dad5fadd8324b65990e277722bcc7c7" candidate_uuid: "561e33c64548493baa0e43c401d0f814" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62ac9c04fd0461ba97a909d1a644b01"
I20260809 18:47:30.226199 26028 raft_consensus.cc:3037] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:30.226223 25782 raft_consensus.cc:3037] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:30.226768 26028 raft_consensus.cc:2454] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561e33c64548493baa0e43c401d0f814 in term 1.
I20260809 18:47:30.226948 26136 leader_election.cc:302] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561e33c64548493baa0e43c401d0f814, b5cdbfe088a344e5bcad5949a91f2008; no voters:
I20260809 18:47:30.227056 26390 raft_consensus.cc:2781] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:47:30.227103 25782 raft_consensus.cc:2454] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561e33c64548493baa0e43c401d0f814 in term 1.
I20260809 18:47:30.227176 26390 raft_consensus.cc:686] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [term 1 LEADER]: Becoming Leader. State: Replica: 561e33c64548493baa0e43c401d0f814, State: Running, Role: LEADER
I20260809 18:47:30.227239 26390 consensus_queue.cc:237] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.227983 25542 catalog_manager.cc:5495] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 reported cstate change: term changed from 0 to 1, leader changed from <none> to 561e33c64548493baa0e43c401d0f814 (127.12.202.195). New cstate: current_term: 1 leader_uuid: "561e33c64548493baa0e43c401d0f814" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } health_report { overall_health: HEALTHY } } }
I20260809 18:47:30.237129 26504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:30.234440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49254 (local address 127.12.202.195:46819)
0809 18:47:30.234603 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:30.234605 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:30.234611 (+ 6us) server_negotiation.cc:407] Connection header received
0809 18:47:30.234644 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:30.234645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:30.234661 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:30.234753 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:47:30.234916 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.235447 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.236217 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.236505 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.236579 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:30.236766 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:47:30.236882 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:47:30.236958 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:30.237005 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 18:47:30.237027 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":106,"threads_started":1}
I20260809 18:47:30.238150 26028 raft_consensus.cc:1261] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008 [term 1 FOLLOWER]: Refusing update from remote peer 561e33c64548493baa0e43c401d0f814: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:47:30.238149 25782 raft_consensus.cc:1261] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01 [term 1 FOLLOWER]: Refusing update from remote peer 561e33c64548493baa0e43c401d0f814: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:47:30.238423 26501 consensus_queue.cc:1035] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:47:30.238543 26390 consensus_queue.cc:1035] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:47:30.241794 25542 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:47:30.241894 25542 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:47:30.242532 25542 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908: Sending DeleteTablet for 3 replicas of tablet 5dad5fadd8324b65990e277722bcc7c7
I20260809 18:47:30.242794 25998 tablet_service.cc:1514] Processing DeleteTablet for tablet 5dad5fadd8324b65990e277722bcc7c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:47:30 UTC) from {username='oryx', principal='oryx/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:50060
I20260809 18:47:30.242837 26221 tablet_service.cc:1514] Processing DeleteTablet for tablet 5dad5fadd8324b65990e277722bcc7c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:47:30 UTC) from {username='oryx', principal='oryx/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:49242
I20260809 18:47:30.242964 26417 tablet_replica.cc:330] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814: stopping tablet replica
I20260809 18:47:30.242970 25752 tablet_service.cc:1514] Processing DeleteTablet for tablet 5dad5fadd8324b65990e277722bcc7c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:47:30 UTC) from {username='oryx', principal='oryx/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:35502
I20260809 18:47:30.243021 26417 raft_consensus.cc:2229] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:47:30.243072 26415 tablet_replica.cc:330] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008: stopping tablet replica
I20260809 18:47:30.243098 26417 raft_consensus.cc:2258] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:47:30.243124 26415 raft_consensus.cc:2229] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:47:30.243161 26415 raft_consensus.cc:2258] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:47:30.243222 26414 tablet_replica.cc:330] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01: stopping tablet replica
I20260809 18:47:30.243274 26414 raft_consensus.cc:2229] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:47:30.243315 26414 raft_consensus.cc:2258] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:47:30.243369 26417 ts_tablet_manager.cc:1905] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:47:30.244167 26414 ts_tablet_manager.cc:1905] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:47:30.244974 26417 ts_tablet_manager.cc:1918] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:47:30.245033 26417 log.cc:1196] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/5dad5fadd8324b65990e277722bcc7c7
I20260809 18:47:30.245255 26417 ts_tablet_manager.cc:1939] T 5dad5fadd8324b65990e277722bcc7c7 P 561e33c64548493baa0e43c401d0f814: Deleting consensus metadata
I20260809 18:47:30.245674 26414 ts_tablet_manager.cc:1918] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:47:30.245693 25524 catalog_manager.cc:4841] TS 561e33c64548493baa0e43c401d0f814 (127.12.202.195:46819): tablet 5dad5fadd8324b65990e277722bcc7c7 (table test-table [id=6f58c12a1027405f91e37619f362fa24]) successfully deleted
I20260809 18:47:30.245725 26414 log.cc:1196] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-0/wal/wals/5dad5fadd8324b65990e277722bcc7c7
I20260809 18:47:30.245946 26414 ts_tablet_manager.cc:1939] T 5dad5fadd8324b65990e277722bcc7c7 P d62ac9c04fd0461ba97a909d1a644b01: Deleting consensus metadata
I20260809 18:47:30.246225 25542 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59772:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:47:30.246376 25542 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:47:30.246930 25524 catalog_manager.cc:4841] TS d62ac9c04fd0461ba97a909d1a644b01 (127.12.202.193:36573): tablet 5dad5fadd8324b65990e277722bcc7c7 (table test-table [id=6f58c12a1027405f91e37619f362fa24]) successfully deleted
I20260809 18:47:30.247782 26221 tablet_service.cc:1467] Processing CreateTablet for tablet 9748e8ed3d86489ba100b7c5ef371225 (DEFAULT_TABLE table=test-table [id=cec3000ef6db4b3587ce5c64bac5fffe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:47:30.247830 25752 tablet_service.cc:1467] Processing CreateTablet for tablet 9748e8ed3d86489ba100b7c5ef371225 (DEFAULT_TABLE table=test-table [id=cec3000ef6db4b3587ce5c64bac5fffe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:47:30.247839 25998 tablet_service.cc:1467] Processing CreateTablet for tablet 9748e8ed3d86489ba100b7c5ef371225 (DEFAULT_TABLE table=test-table [id=cec3000ef6db4b3587ce5c64bac5fffe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:47:30.247917 25752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9748e8ed3d86489ba100b7c5ef371225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:30.247917 26221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9748e8ed3d86489ba100b7c5ef371225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:30.247968 25998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9748e8ed3d86489ba100b7c5ef371225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:30.249121 26381 tablet_bootstrap.cc:492] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814: Bootstrap starting.
I20260809 18:47:30.249552 26383 tablet_bootstrap.cc:492] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008: Bootstrap starting.
I20260809 18:47:30.249610 26381 tablet_bootstrap.cc:654] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:30.249979 26383 tablet_bootstrap.cc:654] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:30.250003 26386 tablet_bootstrap.cc:492] T 9748e8ed3d86489ba100b7c5ef371225 P d62ac9c04fd0461ba97a909d1a644b01: Bootstrap starting.
I20260809 18:47:30.250332 26386 tablet_bootstrap.cc:654] T 9748e8ed3d86489ba100b7c5ef371225 P d62ac9c04fd0461ba97a909d1a644b01: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:30.250655 26415 ts_tablet_manager.cc:1905] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:47:30.250767 26381 tablet_bootstrap.cc:492] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814: No bootstrap required, opened a new log
I20260809 18:47:30.250816 26381 ts_tablet_manager.cc:1397] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 18:47:30.250927 26381 raft_consensus.cc:348] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.250969 26381 raft_consensus.cc:374] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:30.250982 26381 raft_consensus.cc:729] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561e33c64548493baa0e43c401d0f814, State: Initialized, Role: FOLLOWER
I20260809 18:47:30.251039 26381 consensus_queue.cc:260] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.251130 26381 ts_tablet_manager.cc:1428] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:30.252012 26415 ts_tablet_manager.cc:1918] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:47:30.252063 26415 log.cc:1196] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/5dad5fadd8324b65990e277722bcc7c7
I20260809 18:47:30.252265 26415 ts_tablet_manager.cc:1939] T 5dad5fadd8324b65990e277722bcc7c7 P b5cdbfe088a344e5bcad5949a91f2008: Deleting consensus metadata
I20260809 18:47:30.252642 26383 tablet_bootstrap.cc:492] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008: No bootstrap required, opened a new log
I20260809 18:47:30.252689 26383 ts_tablet_manager.cc:1397] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260809 18:47:30.252812 26383 raft_consensus.cc:348] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.252867 26383 raft_consensus.cc:374] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:30.252887 26383 raft_consensus.cc:729] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5cdbfe088a344e5bcad5949a91f2008, State: Initialized, Role: FOLLOWER
I20260809 18:47:30.252944 26383 consensus_queue.cc:260] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.253037 26383 ts_tablet_manager.cc:1428] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:30.253615 25520 catalog_manager.cc:4841] TS b5cdbfe088a344e5bcad5949a91f2008 (127.12.202.194:37503): tablet 5dad5fadd8324b65990e277722bcc7c7 (table test-table [id=6f58c12a1027405f91e37619f362fa24]) successfully deleted
I20260809 18:47:30.256705 26386 tablet_bootstrap.cc:492] T 9748e8ed3d86489ba100b7c5ef371225 P d62ac9c04fd0461ba97a909d1a644b01: No bootstrap required, opened a new log
I20260809 18:47:30.256752 26386 ts_tablet_manager.cc:1397] T 9748e8ed3d86489ba100b7c5ef371225 P d62ac9c04fd0461ba97a909d1a644b01: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260809 18:47:30.256876 26386 raft_consensus.cc:348] T 9748e8ed3d86489ba100b7c5ef371225 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.256945 26386 raft_consensus.cc:374] T 9748e8ed3d86489ba100b7c5ef371225 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:30.256959 26386 raft_consensus.cc:729] T 9748e8ed3d86489ba100b7c5ef371225 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d62ac9c04fd0461ba97a909d1a644b01, State: Initialized, Role: FOLLOWER
I20260809 18:47:30.257009 26386 consensus_queue.cc:260] T 9748e8ed3d86489ba100b7c5ef371225 P d62ac9c04fd0461ba97a909d1a644b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.257110 26386 ts_tablet_manager.cc:1428] T 9748e8ed3d86489ba100b7c5ef371225 P d62ac9c04fd0461ba97a909d1a644b01: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:30.292865 26394 raft_consensus.cc:482] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:47:30.292981 26394 raft_consensus.cc:504] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.293179 26394 leader_election.cc:288] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d62ac9c04fd0461ba97a909d1a644b01 (127.12.202.193:36573), 561e33c64548493baa0e43c401d0f814 (127.12.202.195:46819)
I20260809 18:47:30.293417 26250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9748e8ed3d86489ba100b7c5ef371225" candidate_uuid: "b5cdbfe088a344e5bcad5949a91f2008" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561e33c64548493baa0e43c401d0f814" is_pre_election: true
I20260809 18:47:30.293401 25782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9748e8ed3d86489ba100b7c5ef371225" candidate_uuid: "b5cdbfe088a344e5bcad5949a91f2008" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62ac9c04fd0461ba97a909d1a644b01" is_pre_election: true
I20260809 18:47:30.293546 25782 raft_consensus.cc:2454] T 9748e8ed3d86489ba100b7c5ef371225 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5cdbfe088a344e5bcad5949a91f2008 in term 0.
I20260809 18:47:30.293545 26250 raft_consensus.cc:2454] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5cdbfe088a344e5bcad5949a91f2008 in term 0.
I20260809 18:47:30.293713 25919 leader_election.cc:302] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561e33c64548493baa0e43c401d0f814, b5cdbfe088a344e5bcad5949a91f2008; no voters:
I20260809 18:47:30.293825 26394 raft_consensus.cc:2781] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:47:30.293869 26394 raft_consensus.cc:482] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:47:30.293913 26394 raft_consensus.cc:3037] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:30.294553 26394 raft_consensus.cc:504] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.294682 26394 leader_election.cc:288] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [CANDIDATE]: Term 1 election: Requested vote from peers d62ac9c04fd0461ba97a909d1a644b01 (127.12.202.193:36573), 561e33c64548493baa0e43c401d0f814 (127.12.202.195:46819)
I20260809 18:47:30.294809 25782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9748e8ed3d86489ba100b7c5ef371225" candidate_uuid: "b5cdbfe088a344e5bcad5949a91f2008" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d62ac9c04fd0461ba97a909d1a644b01"
I20260809 18:47:30.294855 26250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9748e8ed3d86489ba100b7c5ef371225" candidate_uuid: "b5cdbfe088a344e5bcad5949a91f2008" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561e33c64548493baa0e43c401d0f814"
I20260809 18:47:30.294880 25782 raft_consensus.cc:3037] T 9748e8ed3d86489ba100b7c5ef371225 P d62ac9c04fd0461ba97a909d1a644b01 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:30.294922 26250 raft_consensus.cc:3037] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:30.295725 25782 raft_consensus.cc:2454] T 9748e8ed3d86489ba100b7c5ef371225 P d62ac9c04fd0461ba97a909d1a644b01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5cdbfe088a344e5bcad5949a91f2008 in term 1.
I20260809 18:47:30.295725 26250 raft_consensus.cc:2454] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5cdbfe088a344e5bcad5949a91f2008 in term 1.
I20260809 18:47:30.295914 25919 leader_election.cc:302] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561e33c64548493baa0e43c401d0f814, b5cdbfe088a344e5bcad5949a91f2008; no voters:
I20260809 18:47:30.296038 26394 raft_consensus.cc:2781] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:47:30.296096 26394 raft_consensus.cc:686] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [term 1 LEADER]: Becoming Leader. State: Replica: b5cdbfe088a344e5bcad5949a91f2008, State: Running, Role: LEADER
I20260809 18:47:30.296150 26394 consensus_queue.cc:237] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } }
I20260809 18:47:30.296900 25542 catalog_manager.cc:5495] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5cdbfe088a344e5bcad5949a91f2008 (127.12.202.194). New cstate: current_term: 1 leader_uuid: "b5cdbfe088a344e5bcad5949a91f2008" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5cdbfe088a344e5bcad5949a91f2008" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 37503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 } health_report { overall_health: UNKNOWN } } }
I20260809 18:47:30.311319 26377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:30.309205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50082 (local address 127.12.202.194:37503)
0809 18:47:30.309245 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:30.309247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:30.309255 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:47:30.309300 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:30.309301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:30.309311 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:30.309364 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:47:30.309461 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.309918 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.310639 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:30.310827 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:30.310895 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:30.311039 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:47:30.311072 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:47:30.311121 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:30.311202 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 18:47:30.311222 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:47:30.313376 26250 raft_consensus.cc:1261] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814 [term 1 FOLLOWER]: Refusing update from remote peer b5cdbfe088a344e5bcad5949a91f2008: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:47:30.313506 25782 raft_consensus.cc:1261] T 9748e8ed3d86489ba100b7c5ef371225 P d62ac9c04fd0461ba97a909d1a644b01 [term 1 FOLLOWER]: Refusing update from remote peer b5cdbfe088a344e5bcad5949a91f2008: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:47:30.313565 26424 consensus_queue.cc:1035] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561e33c64548493baa0e43c401d0f814" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:47:30.313670 26424 consensus_queue.cc:1035] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d62ac9c04fd0461ba97a909d1a644b01" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:47:30.326843 25542 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:47:30.326928 25542 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:47:30.327544 25542 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09ab9561edcb4f199a7650fb70ffb908: Sending DeleteTablet for 3 replicas of tablet 9748e8ed3d86489ba100b7c5ef371225
I20260809 18:47:30.327769 25752 tablet_service.cc:1514] Processing DeleteTablet for tablet 9748e8ed3d86489ba100b7c5ef371225 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:47:30 UTC) from {username='oryx', principal='oryx/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:35502
I20260809 18:47:30.327781 25998 tablet_service.cc:1514] Processing DeleteTablet for tablet 9748e8ed3d86489ba100b7c5ef371225 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:47:30 UTC) from {username='oryx', principal='oryx/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:50060
I20260809 18:47:30.327836 26221 tablet_service.cc:1514] Processing DeleteTablet for tablet 9748e8ed3d86489ba100b7c5ef371225 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:47:30 UTC) from {username='oryx', principal='oryx/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:49242
I20260809 18:47:30.327945 26415 tablet_replica.cc:330] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008: stopping tablet replica
I20260809 18:47:30.327950 26417 tablet_replica.cc:330] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814: stopping tablet replica
I20260809 18:47:30.327983 26414 tablet_replica.cc:330] T 9748e8ed3d86489ba100b7c5ef371225 P d62ac9c04fd0461ba97a909d1a644b01: stopping tablet replica
I20260809 18:47:30.328011 26415 raft_consensus.cc:2229] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:47:30.328011 26417 raft_consensus.cc:2229] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:47:30.328034 26414 raft_consensus.cc:2229] T 9748e8ed3d86489ba100b7c5ef371225 P d62ac9c04fd0461ba97a909d1a644b01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:47:30.328042 26417 raft_consensus.cc:2258] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:47:30.328068 26414 raft_consensus.cc:2258] T 9748e8ed3d86489ba100b7c5ef371225 P d62ac9c04fd0461ba97a909d1a644b01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:47:30.328063 26415 raft_consensus.cc:2258] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:47:30.328347 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 25656
I20260809 18:47:30.328492 26417 ts_tablet_manager.cc:1905] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:47:30.330047 26417 ts_tablet_manager.cc:1918] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:47:30.330101 26417 log.cc:1196] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/9748e8ed3d86489ba100b7c5ef371225
I20260809 18:47:30.330314 26417 ts_tablet_manager.cc:1939] T 9748e8ed3d86489ba100b7c5ef371225 P 561e33c64548493baa0e43c401d0f814: Deleting consensus metadata
I20260809 18:47:30.338647 25524 catalog_manager.cc:4841] TS 561e33c64548493baa0e43c401d0f814 (127.12.202.195:46819): tablet 9748e8ed3d86489ba100b7c5ef371225 (table test-table [id=cec3000ef6db4b3587ce5c64bac5fffe]) successfully deleted
I20260809 18:47:30.340975 26415 ts_tablet_manager.cc:1905] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:47:30.342629 26415 ts_tablet_manager.cc:1918] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 18:47:30.342685 26415 log.cc:1196] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/9748e8ed3d86489ba100b7c5ef371225
I20260809 18:47:30.342909 26415 ts_tablet_manager.cc:1939] T 9748e8ed3d86489ba100b7c5ef371225 P b5cdbfe088a344e5bcad5949a91f2008: Deleting consensus metadata
I20260809 18:47:30.347381 25520 catalog_manager.cc:4841] TS b5cdbfe088a344e5bcad5949a91f2008 (127.12.202.194:37503): tablet 9748e8ed3d86489ba100b7c5ef371225 (table test-table [id=cec3000ef6db4b3587ce5c64bac5fffe]) successfully deleted
W20260809 18:47:30.347806 25524 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.202.193:36573 (error 108)
I20260809 18:47:30.348387 26525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:30.348164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:36573 (local address 127.0.0.1:35528)
0809 18:47:30.348262 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:30.348336 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:36573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":46,"threads_started":1}
I20260809 18:47:30.348486 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 25887
W20260809 18:47:30.364795 25524 catalog_manager.cc:4584] TS d62ac9c04fd0461ba97a909d1a644b01 (127.12.202.193:36573): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9748e8ed3d86489ba100b7c5ef371225: Network error: Client connection negotiation failed: client connection to 127.12.202.193:36573: connect: Connection refused (error 111)
I20260809 18:47:30.366892 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 26106
I20260809 18:47:30.383730 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 25497
2026-08-09T18:47:30Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2917 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:47:30 dist-test-slave-45dx krb5kdc[26529](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:47:30 dist-test-slave-45dx krb5kdc[26529](info): set up 2 sockets
Aug 09 18:47:30 dist-test-slave-45dx krb5kdc[26529](info): commencing operation
krb5kdc: starting...
W20260809 18:47:31.648470 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:47:31 dist-test-slave-45dx krb5kdc[26529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:47:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:47:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:47:31.771045 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:42889
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:44941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:42889
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:47:31.851372 26551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:31.851564 26551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:31.851588 26551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:31.852663 26551 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:47:31.852696 26551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:31.852710 26551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:31.852722 26551 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:47:31.852733 26551 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:47:31.854079 26551 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:44941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:42889
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:42889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26551
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:31.854269 26551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:31.854426 26551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:31.859090 26565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:31.859103 26567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:31.859239 26551 server_base.cc:1034] running on GCE node
W20260809 18:47:31.859078 26564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:31.859674 26551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:31.859992 26551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:31.861141 26551 hybrid_clock.cc:648] HybridClock initialized: now 1786301251861126 us; error 29 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T18:47:31Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1471 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:47:31 dist-test-slave-45dx krb5kdc[26575](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:47:31 dist-test-slave-45dx krb5kdc[26575](info): set up 2 sockets
Aug 09 18:47:31 dist-test-slave-45dx krb5kdc[26575](info): commencing operation
krb5kdc: starting...
W20260809 18:47:33.128684 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:47:33 dist-test-slave-45dx krb5kdc[26575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301253, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:47:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:47:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:47:33.251385 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:43279
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:43279
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:47:33.333727 26594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:33.333936 26594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:33.333957 26594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:33.335009 26594 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:47:33.335043 26594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:33.335057 26594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:33.335069 26594 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:47:33.335080 26594 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:47:33.336514 26594 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:43279
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:43279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26594
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:33.336719 26594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:33.336894 26594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:33.341773 26616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:33.341797 26608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:33.341773 26606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:33.341907 26594 server_base.cc:1034] running on GCE node
I20260809 18:47:33.342232 26594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:33.342535 26594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:33.343679 26594 hybrid_clock.cc:648] HybridClock initialized: now 1786301253343662 us; error 42 us; skew 500 ppm
Aug 09 18:47:33 dist-test-slave-45dx krb5kdc[26575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301253, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:47:33.349407 26594 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:47:33.349893 26594 webserver.cc:460] Webserver started at http://127.12.202.254:43689/ using document root <none> and password file <none>
I20260809 18:47:33.350131 26594 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:33.350175 26594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:33.350346 26594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:33.351483 26594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "6018bea9efdf4ddab921b058f9a33b47"
format_stamp: "Formatted at 2026-08-09 18:47:33 on dist-test-slave-45dx"
server_key: "4aed07da5cfc17f19a2367173ef2d97d"
server_key_iv: "a27a9b8f214c4142a0fd98f75412d591"
server_key_version: "encryptionkey@0"
I20260809 18:47:33.351868 26594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "6018bea9efdf4ddab921b058f9a33b47"
format_stamp: "Formatted at 2026-08-09 18:47:33 on dist-test-slave-45dx"
server_key: "4aed07da5cfc17f19a2367173ef2d97d"
server_key_iv: "a27a9b8f214c4142a0fd98f75412d591"
server_key_version: "encryptionkey@0"
I20260809 18:47:33.353284 26594 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:47:33.354045 26625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:33.354274 26594 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:47:33.354352 26594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "6018bea9efdf4ddab921b058f9a33b47"
format_stamp: "Formatted at 2026-08-09 18:47:33 on dist-test-slave-45dx"
server_key: "4aed07da5cfc17f19a2367173ef2d97d"
server_key_iv: "a27a9b8f214c4142a0fd98f75412d591"
server_key_version: "encryptionkey@0"
I20260809 18:47:33.354455 26594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:33.370404 26594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:33.372380 26594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:33.372536 26594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:33.376588 26594 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:43279
I20260809 18:47:33.376626 26705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:43279 every 8 connection(s)
I20260809 18:47:33.376971 26594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:47:33.377816 26706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:33.380038 26706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47: Bootstrap starting.
I20260809 18:47:33.380648 26706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:33.380952 26706 log.cc:824] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47: Log is configured to *not* fsync() on all Append() calls
I20260809 18:47:33.381654 26706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47: No bootstrap required, opened a new log
I20260809 18:47:33.383287 26706 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6018bea9efdf4ddab921b058f9a33b47" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43279 } }
I20260809 18:47:33.383422 26706 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:33.383445 26706 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6018bea9efdf4ddab921b058f9a33b47, State: Initialized, Role: FOLLOWER
I20260809 18:47:33.383605 26706 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6018bea9efdf4ddab921b058f9a33b47" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43279 } }
I20260809 18:47:33.383666 26706 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:47:33.383705 26706 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:47:33.383752 26706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:33.384272 26706 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6018bea9efdf4ddab921b058f9a33b47" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43279 } }
I20260809 18:47:33.384446 26706 leader_election.cc:302] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6018bea9efdf4ddab921b058f9a33b47; no voters:
I20260809 18:47:33.384637 26706 leader_election.cc:288] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:47:33.384692 26709 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:47:33.384864 26709 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [term 1 LEADER]: Becoming Leader. State: Replica: 6018bea9efdf4ddab921b058f9a33b47, State: Running, Role: LEADER
I20260809 18:47:33.384927 26706 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:47:33.384979 26709 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6018bea9efdf4ddab921b058f9a33b47" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43279 } }
I20260809 18:47:33.385365 26715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6018bea9efdf4ddab921b058f9a33b47. Latest consensus state: current_term: 1 leader_uuid: "6018bea9efdf4ddab921b058f9a33b47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6018bea9efdf4ddab921b058f9a33b47" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43279 } } }
I20260809 18:47:33.385497 26715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [sys.catalog]: This master's current role is: LEADER
I20260809 18:47:33.385495 26710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6018bea9efdf4ddab921b058f9a33b47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6018bea9efdf4ddab921b058f9a33b47" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43279 } } }
I20260809 18:47:33.385644 26710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [sys.catalog]: This master's current role is: LEADER
I20260809 18:47:33.386051 26736 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:47:33.386318 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 26594
I20260809 18:47:33.386444 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:47:33.386600 26736 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:47:33.386665 13099 external_mini_cluster.cc:1428] Setting key 60c72df076d63ddbb0094d3d14d8f357
I20260809 18:47:33.388478 26736 catalog_manager.cc:1347] Generated new cluster ID: c3da0db5caf34257a8e3a0f263c18370
I20260809 18:47:33.388546 26736 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:47:33 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301253, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:47:33.402993 26751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:33.387111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34958 (local address 127.12.202.254:43279)
0809 18:47:33.387482 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:33.387489 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:33.387683 (+ 194us) server_negotiation.cc:407] Connection header received
0809 18:47:33.388006 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:33.388014 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:33.388077 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:33.388216 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:33.393003 (+ 4787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:33.394794 (+ 1791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:33.395798 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:33.396437 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:33.396544 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:33.399324 (+ 2780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:33.399327 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:33.399328 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:33.399339 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:33.401337 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:33.401777 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:33.401780 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:33.401780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:33.401885 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:33.402092 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:33.402092 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:33.402093 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:33.402387 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:33.402527 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:33.402652 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 18:47:33.402775 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":94,"threads_started":1}
I20260809 18:47:33.430676 26736 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:47:33.431203 26736 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:47:33.436736 26736 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47: Generated new TSK 0
I20260809 18:47:33.436918 26736 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
I20260809 18:47:33.464602 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:43279
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:47:33.546669 26756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:33.546903 26756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:33.546944 26756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:33.548105 26756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:33.548169 26756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:33.548211 26756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:47:33.549718 26756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:43279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:33.549990 26756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:33.550220 26756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:33.555223 26766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:33.555233 26769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:33.555317 26767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:33.555416 26756 server_base.cc:1034] running on GCE node
I20260809 18:47:33.555814 26756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:33.556049 26756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:33.557205 26756 hybrid_clock.cc:648] HybridClock initialized: now 1786301253557188 us; error 29 us; skew 500 ppm
Aug 09 18:47:33 dist-test-slave-45dx krb5kdc[26575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301253, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:47:33.559825 26756 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:47:33.560251 26756 webserver.cc:460] Webserver started at http://127.12.202.193:41253/ using document root <none> and password file <none>
I20260809 18:47:33.560514 26756 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:33.560601 26756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:33.560750 26756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:33.561775 26756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "9b5ece1a802748afa8bc0f5cf60875f0"
format_stamp: "Formatted at 2026-08-09 18:47:33 on dist-test-slave-45dx"
server_key: "41b2c9f25968b79c0614a6f8bec799a7"
server_key_iv: "39052ebdf9332053ce3a2a1e60d3d40a"
server_key_version: "encryptionkey@0"
I20260809 18:47:33.562148 26756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "9b5ece1a802748afa8bc0f5cf60875f0"
format_stamp: "Formatted at 2026-08-09 18:47:33 on dist-test-slave-45dx"
server_key: "41b2c9f25968b79c0614a6f8bec799a7"
server_key_iv: "39052ebdf9332053ce3a2a1e60d3d40a"
server_key_version: "encryptionkey@0"
I20260809 18:47:33.563498 26756 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:47:33.564229 26782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:33.564445 26756 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:47:33.564535 26756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "9b5ece1a802748afa8bc0f5cf60875f0"
format_stamp: "Formatted at 2026-08-09 18:47:33 on dist-test-slave-45dx"
server_key: "41b2c9f25968b79c0614a6f8bec799a7"
server_key_iv: "39052ebdf9332053ce3a2a1e60d3d40a"
server_key_version: "encryptionkey@0"
I20260809 18:47:33.564587 26756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:33.574124 26756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:33.576377 26756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:33.576485 26756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:33.576638 26756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:47:33.576884 26756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:47:33.576915 26756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:33.576934 26756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:47:33.576946 26756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:33.582569 26756 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:38949
I20260809 18:47:33.582645 26955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:38949 every 8 connection(s)
I20260809 18:47:33.582995 26756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
Aug 09 18:47:33 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301253, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:47:33.589576 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 26756
I20260809 18:47:33.589691 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:47:33.589934 13099 external_mini_cluster.cc:1428] Setting key 6b98e3d873429db62c3e8cd294edb38d
I20260809 18:47:33.592957 26751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:33.583742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:36093 (local address 127.12.202.254:43279)
0809 18:47:33.583809 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:33.583811 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:33.584035 (+ 224us) server_negotiation.cc:407] Connection header received
0809 18:47:33.584635 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:33.584636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:33.584651 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:33.584703 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:33.585761 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:33.586305 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:33.587351 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:33.587561 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:33.587635 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:33.589742 (+ 2107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:33.589744 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:33.589744 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:33.589754 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:33.591545 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:33.591936 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:33.591937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:33.591938 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:33.592004 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:33.592234 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:33.592235 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:33.592235 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:33.592410 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:33.592480 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:33.592822 (+ 342us) server_negotiation.cc:299] Negotiation successful
0809 18:47:33.592894 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 18:47:33.593218 26963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:33.583726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:36093)
0809 18:47:33.583913 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:33.583950 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:33.584518 (+ 568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:33.584770 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:33.584774 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:33.585427 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:33.585665 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:33.585670 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:33.586411 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:33.586412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:33.587247 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:33.587250 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:33.587645 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:33.587646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:33.587762 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:33.588153 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:33.588161 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:33.589605 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:33.591633 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:33.591639 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:33.591641 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:33.591860 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:33.592072 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:33.592073 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:33.592073 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:33.592171 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:33.592490 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:33.592497 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:33.592666 (+ 169us) client_negotiation.cc:769] Sending connection context
0809 18:47:33.592791 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 18:47:33.592964 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":89,"threads_started":1}
I20260809 18:47:33.593779 26959 heartbeater.cc:347] Connected to a master server at 127.12.202.254:43279
I20260809 18:47:33.593885 26959 heartbeater.cc:464] Registering TS with master...
I20260809 18:47:33.594046 26959 heartbeater.cc:511] Master 127.12.202.254:43279 requested a full tablet report, sending...
I20260809 18:47:33.594506 26654 ts_manager.cc:194] Registered new tserver with Master: 9b5ece1a802748afa8bc0f5cf60875f0 (127.12.202.193:38949)
I20260809 18:47:33.595134 26654 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:36093
WARNING: no policy specified for kudu/127.12.202.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
I20260809 18:47:33.617166 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:43279
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:47:33.698347 26968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:33.698625 26968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:33.698661 26968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:33.700196 26968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:33.700242 26968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:33.700270 26968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:47:33.701782 26968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:43279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:33.701977 26968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:33.702144 26968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:33.707106 26978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:33.707145 26982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:33.707275 26979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:33.707520 26968 server_base.cc:1034] running on GCE node
I20260809 18:47:33.707675 26968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:33.707857 26968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:33.708992 26968 hybrid_clock.cc:648] HybridClock initialized: now 1786301253708966 us; error 42 us; skew 500 ppm
Aug 09 18:47:33 dist-test-slave-45dx krb5kdc[26575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301253, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:47:33.711511 26968 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:47:33.711948 26968 webserver.cc:460] Webserver started at http://127.12.202.194:40131/ using document root <none> and password file <none>
I20260809 18:47:33.712186 26968 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:33.712231 26968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:33.712421 26968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:33.713449 26968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "afb735714e424cbb8ba7992ff7c2df6c"
format_stamp: "Formatted at 2026-08-09 18:47:33 on dist-test-slave-45dx"
server_key: "f48e997e8af8c4dce95f350164cea241"
server_key_iv: "c0635fc11c1569994e02ef5853113077"
server_key_version: "encryptionkey@0"
I20260809 18:47:33.713732 26968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "afb735714e424cbb8ba7992ff7c2df6c"
format_stamp: "Formatted at 2026-08-09 18:47:33 on dist-test-slave-45dx"
server_key: "f48e997e8af8c4dce95f350164cea241"
server_key_iv: "c0635fc11c1569994e02ef5853113077"
server_key_version: "encryptionkey@0"
I20260809 18:47:33.715030 26968 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:47:33.715713 26991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:33.715893 26968 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:47:33.715992 26968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "afb735714e424cbb8ba7992ff7c2df6c"
format_stamp: "Formatted at 2026-08-09 18:47:33 on dist-test-slave-45dx"
server_key: "f48e997e8af8c4dce95f350164cea241"
server_key_iv: "c0635fc11c1569994e02ef5853113077"
server_key_version: "encryptionkey@0"
I20260809 18:47:33.716075 26968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:33.726998 26968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:33.728789 26968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:33.728950 26968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:33.729166 26968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:47:33.729466 26968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:47:33.729521 26968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:33.729554 26968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:47:33.729581 26968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:33.735513 26968 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:44815
I20260809 18:47:33.735550 27176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:44815 every 8 connection(s)
I20260809 18:47:33.735848 26968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
Aug 09 18:47:33 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301253, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:47:33.741608 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 26968
I20260809 18:47:33.741751 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:47:33.741954 13099 external_mini_cluster.cc:1428] Setting key dea4b354a0d2eef6c3751f2b4ee4886b
I20260809 18:47:33.744923 26751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:33.736621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:34455 (local address 127.12.202.254:43279)
0809 18:47:33.736686 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:33.736688 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:33.736923 (+ 235us) server_negotiation.cc:407] Connection header received
0809 18:47:33.737353 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:33.737354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:33.737365 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:33.737420 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:33.738251 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:33.738733 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:33.739659 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:33.739858 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:33.739912 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:33.741984 (+ 2072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:33.741986 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:33.741986 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:33.741993 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:33.743498 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:33.743905 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:33.743906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:33.743907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:33.743971 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:33.744236 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:33.744237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:33.744237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:33.744411 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:33.744482 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:33.744749 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 18:47:33.744838 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 18:47:33.745107 27181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:33.736596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:34455)
0809 18:47:33.736761 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:33.736802 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:33.737275 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:33.737467 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:33.737470 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:33.738003 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:33.738180 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:33.738184 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:33.738814 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:33.738814 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:33.739576 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:33.739579 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:33.739934 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:33.739934 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:33.740032 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:33.740464 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:33.740471 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:33.741882 (+ 1411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:33.743599 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:33.743607 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:33.743608 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:33.743829 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:33.744044 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:33.744045 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:33.744045 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:33.744154 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:33.744486 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:33.744494 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:33.744623 (+ 129us) client_negotiation.cc:769] Sending connection context
0809 18:47:33.744728 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 18:47:33.744876 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":97,"threads_started":1}
I20260809 18:47:33.745548 27177 heartbeater.cc:347] Connected to a master server at 127.12.202.254:43279
I20260809 18:47:33.745623 27177 heartbeater.cc:464] Registering TS with master...
I20260809 18:47:33.745817 27177 heartbeater.cc:511] Master 127.12.202.254:43279 requested a full tablet report, sending...
I20260809 18:47:33.746168 26654 ts_manager.cc:194] Registered new tserver with Master: afb735714e424cbb8ba7992ff7c2df6c (127.12.202.194:44815)
I20260809 18:47:33.746538 26654 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:34455
WARNING: no policy specified for kudu/127.12.202.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
I20260809 18:47:33.769107 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:43279
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:47:33.850306 27185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:33.850533 27185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:33.850574 27185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:33.851717 27185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:33.851784 27185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:33.851838 27185 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:47:33.853466 27185 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:43279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:33.853714 27185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:33.853950 27185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:33.859028 27192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:33.859041 27195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:33.859170 27185 server_base.cc:1034] running on GCE node
W20260809 18:47:33.859030 27193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:33.859431 27185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:33.859676 27185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:33.860810 27185 hybrid_clock.cc:648] HybridClock initialized: now 1786301253860800 us; error 29 us; skew 500 ppm
Aug 09 18:47:33 dist-test-slave-45dx krb5kdc[26575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301253, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:47:33.863524 27185 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:47:33.863979 27185 webserver.cc:460] Webserver started at http://127.12.202.195:44171/ using document root <none> and password file <none>
I20260809 18:47:33.864228 27185 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:33.864276 27185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:33.864454 27185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:33.865554 27185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "8c669b75b25846778516a80c05f5d6e6"
format_stamp: "Formatted at 2026-08-09 18:47:33 on dist-test-slave-45dx"
server_key: "c2ecce51e4aafaea20714d6f9e18a26e"
server_key_iv: "cdc686bddfb22ae7cab39c586ac9ce40"
server_key_version: "encryptionkey@0"
I20260809 18:47:33.865923 27185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "8c669b75b25846778516a80c05f5d6e6"
format_stamp: "Formatted at 2026-08-09 18:47:33 on dist-test-slave-45dx"
server_key: "c2ecce51e4aafaea20714d6f9e18a26e"
server_key_iv: "cdc686bddfb22ae7cab39c586ac9ce40"
server_key_version: "encryptionkey@0"
I20260809 18:47:33.867347 27185 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:47:33.868084 27205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:33.868283 27185 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:47:33.868402 27185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "8c669b75b25846778516a80c05f5d6e6"
format_stamp: "Formatted at 2026-08-09 18:47:33 on dist-test-slave-45dx"
server_key: "c2ecce51e4aafaea20714d6f9e18a26e"
server_key_iv: "cdc686bddfb22ae7cab39c586ac9ce40"
server_key_version: "encryptionkey@0"
I20260809 18:47:33.868458 27185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:33.881856 27185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:33.884178 27185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:33.884358 27185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:33.884608 27185 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:47:33.884964 27185 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:47:33.885012 27185 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:33.885035 27185 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:47:33.885046 27185 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:33.891448 27185 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:33065
I20260809 18:47:33.891491 27384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:33065 every 8 connection(s)
I20260809 18:47:33.891839 27185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:47:33.893882 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 27185
I20260809 18:47:33.894027 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:47:33.894239 13099 external_mini_cluster.cc:1428] Setting key e8c6e47bce80d0c00a5b6745b4328844
Aug 09 18:47:33 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301253, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:47:33.901449 26751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:33.892549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:50795 (local address 127.12.202.254:43279)
0809 18:47:33.892594 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:33.892596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:33.892886 (+ 290us) server_negotiation.cc:407] Connection header received
0809 18:47:33.893509 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:33.893510 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:33.893524 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:33.893584 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:33.894967 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:33.895560 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:33.896600 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:33.896782 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:33.896844 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:33.898869 (+ 2025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:33.898871 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:33.898871 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:33.898878 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:33.900294 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:33.900693 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:33.900694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:33.900694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:33.900747 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:33.900962 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:33.900962 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:33.900963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:33.901060 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:33.901111 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:33.901329 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 18:47:33.901388 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:47:33.901654 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:33.892524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.195:50795)
0809 18:47:33.892685 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:33.892786 (+ 101us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:33.893317 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:33.893651 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:33.893656 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:33.894482 (+ 826us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:33.894839 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:33.894847 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:33.895640 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:33.895641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:33.896527 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:33.896530 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:33.896862 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:33.896862 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:33.896966 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:33.897420 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:33.897428 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:33.898774 (+ 1346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:33.900416 (+ 1642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:33.900422 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:33.900423 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:33.900629 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:33.900804 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:33.900804 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:33.900804 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:33.900898 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:33.901115 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:33.901119 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:33.901222 (+ 103us) client_negotiation.cc:769] Sending connection context
0809 18:47:33.901298 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 18:47:33.901411 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":82,"threads_started":1}
I20260809 18:47:33.902168 27387 heartbeater.cc:347] Connected to a master server at 127.12.202.254:43279
I20260809 18:47:33.902261 27387 heartbeater.cc:464] Registering TS with master...
I20260809 18:47:33.902405 27387 heartbeater.cc:511] Master 127.12.202.254:43279 requested a full tablet report, sending...
I20260809 18:47:33.902776 26654 ts_manager.cc:194] Registered new tserver with Master: 8c669b75b25846778516a80c05f5d6e6 (127.12.202.195:33065)
I20260809 18:47:33.903136 26654 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:50795
I20260809 18:47:33.906164 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.193.keytab.
Entry for principal oryx/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.193.keytab.
WARNING: no policy specified for oryx/127.12.202.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.194.keytab.
Entry for principal oryx/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.194.keytab.
WARNING: no policy specified for oryx/127.12.202.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.195.keytab.
Entry for principal oryx/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.195.keytab.
I20260809 18:47:33.980919 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 26756
I20260809 18:47:33.997267 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 26968
I20260809 18:47:34.009363 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 27185
I20260809 18:47:34.018787 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 26594
I20260809 18:47:34.032516 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:43279
--webserver_interface=127.12.202.254
--webserver_port=43689
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:43279
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:47:34.114781 27399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:34.115026 27399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:34.115067 27399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:34.116194 27399 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:47:34.116267 27399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:34.116292 27399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:34.116348 27399 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:47:34.116376 27399 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:47:34.117846 27399 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:43279
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:43279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=43689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:34.118131 27399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:34.118353 27399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:34.123190 27407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:34.123183 27406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:34.123224 27399 server_base.cc:1034] running on GCE node
W20260809 18:47:34.123183 27409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:34.123610 27399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:34.123910 27399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:34.125085 27399 hybrid_clock.cc:648] HybridClock initialized: now 1786301254125081 us; error 34 us; skew 500 ppm
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301254, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:47:34.127511 27399 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:47:34.127923 27399 webserver.cc:460] Webserver started at http://127.12.202.254:43689/ using document root <none> and password file <none>
I20260809 18:47:34.128168 27399 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:34.128257 27399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:34.129640 27399 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:47:34.130371 27422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:34.130569 27399 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:47:34.130664 27399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "6018bea9efdf4ddab921b058f9a33b47"
format_stamp: "Formatted at 2026-08-09 18:47:33 on dist-test-slave-45dx"
server_key: "4aed07da5cfc17f19a2367173ef2d97d"
server_key_iv: "a27a9b8f214c4142a0fd98f75412d591"
server_key_version: "encryptionkey@0"
I20260809 18:47:34.131047 27399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:34.146618 27399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:34.148860 27399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:34.149030 27399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:34.153136 27399 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:43279
I20260809 18:47:34.153187 27510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:43279 every 8 connection(s)
I20260809 18:47:34.153579 27399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:47:34.155131 27511 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:47:34.155875 27511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47: Bootstrap starting.
I20260809 18:47:34.157949 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 27399
I20260809 18:47:34.158329 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:38949
--local_ip_for_outbound_sockets=127.12.202.193
--tserver_master_addrs=127.12.202.254:43279
--webserver_port=41253
--webserver_interface=127.12.202.193
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.202.193
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:47:34.165201 27511 log.cc:824] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47: Log is configured to *not* fsync() on all Append() calls
I20260809 18:47:34.166810 27511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:47:34.167111 27511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47: Bootstrap complete.
I20260809 18:47:34.169436 27511 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6018bea9efdf4ddab921b058f9a33b47" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43279 } }
I20260809 18:47:34.169657 27511 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6018bea9efdf4ddab921b058f9a33b47, State: Initialized, Role: FOLLOWER
I20260809 18:47:34.169836 27511 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6018bea9efdf4ddab921b058f9a33b47" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43279 } }
I20260809 18:47:34.169909 27511 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:47:34.169978 27511 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:47:34.170029 27511 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [term 1 FOLLOWER]: Advancing to term 2
I20260809 18:47:34.171038 27511 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6018bea9efdf4ddab921b058f9a33b47" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43279 } }
I20260809 18:47:34.171151 27511 leader_election.cc:302] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6018bea9efdf4ddab921b058f9a33b47; no voters:
I20260809 18:47:34.171361 27511 leader_election.cc:288] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 18:47:34.171397 27517 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 18:47:34.171525 27517 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [term 2 LEADER]: Becoming Leader. State: Replica: 6018bea9efdf4ddab921b058f9a33b47, State: Running, Role: LEADER
I20260809 18:47:34.171656 27511 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:47:34.171728 27517 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6018bea9efdf4ddab921b058f9a33b47" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43279 } }
I20260809 18:47:34.172010 27517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6018bea9efdf4ddab921b058f9a33b47. Latest consensus state: current_term: 2 leader_uuid: "6018bea9efdf4ddab921b058f9a33b47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6018bea9efdf4ddab921b058f9a33b47" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43279 } } }
I20260809 18:47:34.172016 27520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6018bea9efdf4ddab921b058f9a33b47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6018bea9efdf4ddab921b058f9a33b47" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43279 } } }
I20260809 18:47:34.172108 27517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [sys.catalog]: This master's current role is: LEADER
I20260809 18:47:34.172135 27520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47 [sys.catalog]: This master's current role is: LEADER
I20260809 18:47:34.172328 27528 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:47:34.172873 27528 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:47:34.173024 27528 catalog_manager.cc:1259] Loaded cluster ID: c3da0db5caf34257a8e3a0f263c18370
I20260809 18:47:34.173100 27528 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:47:34.174615 27528 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:47:34.174798 27528 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6018bea9efdf4ddab921b058f9a33b47: Loaded TSK: 0
I20260809 18:47:34.175007 27528 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 18:47:34.243813 27514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:34.244040 27514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:34.244077 27514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:34.245293 27514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:34.245360 27514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:34.245404 27514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:47:34.246888 27514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.193.keytab
--principal=oryx/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:38949
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=41253
--tserver_master_addrs=127.12.202.254:43279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:34.247152 27514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:34.247393 27514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:34.253563 27549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:34.253659 27556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:34.253593 27548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:34.253831 27514 server_base.cc:1034] running on GCE node
I20260809 18:47:34.254143 27514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:34.254426 27514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:34.255601 27514 hybrid_clock.cc:648] HybridClock initialized: now 1786301254255586 us; error 32 us; skew 500 ppm
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301254, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:47:34.258303 27514 init.cc:377] Logged in from keytab as oryx/127.12.202.193@KRBTEST.COM (short username oryx)
I20260809 18:47:34.258773 27514 webserver.cc:460] Webserver started at http://127.12.202.193:41253/ using document root <none> and password file <none>
I20260809 18:47:34.259034 27514 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:34.259119 27514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:34.260577 27514 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260809 18:47:34.261337 27569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:34.261580 27514 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:47:34.261682 27514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "9b5ece1a802748afa8bc0f5cf60875f0"
format_stamp: "Formatted at 2026-08-09 18:47:33 on dist-test-slave-45dx"
server_key: "41b2c9f25968b79c0614a6f8bec799a7"
server_key_iv: "39052ebdf9332053ce3a2a1e60d3d40a"
server_key_version: "encryptionkey@0"
I20260809 18:47:34.262145 27514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:34.282900 27514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:34.285568 27514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:34.285741 27514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:34.286008 27514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:47:34.286403 27514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:47:34.286458 27514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:34.286490 27514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:47:34.286515 27514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:34.293887 27514 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:38949
I20260809 18:47:34.293969 27757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:38949 every 8 connection(s)
I20260809 18:47:34.294317 27514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:34.303828 27765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:34.295118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:40049)
0809 18:47:34.295335 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:34.295381 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:34.295990 (+ 609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:34.296456 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:34.296461 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:34.297209 (+ 748us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:34.297472 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:34.297478 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.298565 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.298566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:34.299780 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:34.299783 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.300386 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.300387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:34.300530 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.301101 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:34.301111 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:34.303610 (+ 2499us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":118,"threads_started":1}
W20260809 18:47:34.303891 27766 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:34.295259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:40049 (local address 127.12.202.254:43279)
0809 18:47:34.295462 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:34.295470 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:34.295499 (+ 29us) server_negotiation.cc:407] Connection header received
0809 18:47:34.296181 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:34.296186 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:34.296228 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:34.296411 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:34.297584 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.298448 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.299871 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.300264 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.300417 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.303735 (+ 3318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.193:40049: BlockingRecv error: recv got EOF from 127.12.202.193:40049 (error 108)
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":85,"threads_started":1}
W20260809 18:47:34.304045 27760 heartbeater.cc:644] Failed to heartbeat to 127.12.202.254:43279 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.202.254:43279: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
I20260809 18:47:34.304369 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 27514
I20260809 18:47:34.304742 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:44815
--local_ip_for_outbound_sockets=127.12.202.194
--tserver_master_addrs=127.12.202.254:43279
--webserver_port=40131
--webserver_interface=127.12.202.194
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.202.194
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:34.309491 27765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:34.304309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:39743)
0809 18:47:34.304381 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:34.304394 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:34.304488 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:34.304755 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:34.304756 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:34.304924 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:34.304989 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:34.304991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.305903 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.305904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:34.306613 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:34.306615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.306964 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.306965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:34.307030 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.307455 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:34.307460 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:34.309424 (+ 1964us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 18:47:34.310472 27768 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:34.304440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:39743 (local address 127.12.202.254:43279)
0809 18:47:34.304608 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:34.304611 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:34.304619 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:47:34.304640 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:34.304641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:34.304652 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:34.304719 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:34.305074 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.305813 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.306703 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.306893 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.306965 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.309977 (+ 3012us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.193:39743: BlockingRecv error: recv got EOF from 127.12.202.193:39743 (error 108)
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":108,"threads_started":1}
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:34.315505 27765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:34.310155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:54499)
0809 18:47:34.310275 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:34.310286 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:34.310334 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:34.310500 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:34.310502 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:34.310673 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:34.310715 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:34.310716 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.311575 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.311576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:34.312483 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:34.312486 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.312917 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.312918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:34.312981 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.313477 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:34.313484 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:34.315427 (+ 1943us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103}
W20260809 18:47:34.315557 27766 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:34.310226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:54499 (local address 127.12.202.254:43279)
0809 18:47:34.310290 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:34.310292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:34.310320 (+ 28us) server_negotiation.cc:407] Connection header received
0809 18:47:34.310393 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:34.310393 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:34.310404 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:34.310798 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:34.310829 (+ 31us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.311487 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.312588 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.312837 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.312899 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.315498 (+ 2599us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.193:54499: BlockingRecv error: recv got EOF from 127.12.202.193:54499 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260809 18:47:34.315829 27760 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 18:47:34.389271 27769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:34.389513 27769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:34.389555 27769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:34.390795 27769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:34.390854 27769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:34.390897 27769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:47:34.392520 27769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.194.keytab
--principal=oryx/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:44815
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=40131
--tserver_master_addrs=127.12.202.254:43279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:34.392792 27769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:34.393026 27769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:34.398274 27783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:34.398340 27775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:34.398401 27769 server_base.cc:1034] running on GCE node
W20260809 18:47:34.398285 27779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:34.398699 27769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:34.398962 27769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:34.400108 27769 hybrid_clock.cc:648] HybridClock initialized: now 1786301254400097 us; error 29 us; skew 500 ppm
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301254, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:47:34.402707 27769 init.cc:377] Logged in from keytab as oryx/127.12.202.194@KRBTEST.COM (short username oryx)
I20260809 18:47:34.403146 27769 webserver.cc:460] Webserver started at http://127.12.202.194:40131/ using document root <none> and password file <none>
I20260809 18:47:34.403375 27769 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:34.403460 27769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:34.405066 27769 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:47:34.405671 27792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:34.405853 27769 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:47:34.405961 27769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "afb735714e424cbb8ba7992ff7c2df6c"
format_stamp: "Formatted at 2026-08-09 18:47:33 on dist-test-slave-45dx"
server_key: "f48e997e8af8c4dce95f350164cea241"
server_key_iv: "c0635fc11c1569994e02ef5853113077"
server_key_version: "encryptionkey@0"
I20260809 18:47:34.406288 27769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:34.424576 27769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:34.426956 27769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:34.427119 27769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:34.427383 27769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:47:34.427708 27769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:47:34.427762 27769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:34.427814 27769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:47:34.427843 27769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:34.433964 27769 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:44815
I20260809 18:47:34.434018 27971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:44815 every 8 connection(s)
I20260809 18:47:34.434366 27769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:34.441195 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 27769
I20260809 18:47:34.441545 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:33065
--local_ip_for_outbound_sockets=127.12.202.195
--tserver_master_addrs=127.12.202.254:43279
--webserver_port=44171
--webserver_interface=127.12.202.195
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.202.195
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:47:34.442099 27766 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:34.435089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:52419 (local address 127.12.202.254:43279)
0809 18:47:34.435143 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:34.435146 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:34.435335 (+ 189us) server_negotiation.cc:407] Connection header received
0809 18:47:34.435876 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:34.435877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:34.435894 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:34.435943 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:34.437035 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.437533 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.438526 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.438721 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.438798 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.442051 (+ 3253us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.194:52419: BlockingRecv error: recv got EOF from 127.12.202.194:52419 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:47:34.442184 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:34.435054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:52419)
0809 18:47:34.435203 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:34.435251 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:34.435765 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:34.436012 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:34.436016 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:34.436708 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:34.436928 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:34.436933 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.437639 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.437640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:34.438433 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:34.438435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.438807 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.438814 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:34.438940 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.439444 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:34.439452 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:34.441954 (+ 2502us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":69,"threads_started":1}
W20260809 18:47:34.442479 27974 heartbeater.cc:644] Failed to heartbeat to 127.12.202.254:43279 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.202.254:43279: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:34.447510 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:34.442758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:40323)
0809 18:47:34.442810 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:34.442821 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:34.442891 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:34.443035 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:34.443036 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:34.443169 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:34.443211 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:34.443212 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.443894 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.443895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:34.444718 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:34.444720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.445194 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.445195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:34.445254 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.445676 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:34.445682 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:34.447464 (+ 1782us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 18:47:34.447662 27766 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:34.442813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:40323 (local address 127.12.202.254:43279)
0809 18:47:34.442875 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:34.442877 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:34.442887 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:47:34.442962 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:34.442963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:34.442976 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:34.443027 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:34.443317 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.443815 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.444798 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.445093 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.445169 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.447584 (+ 2415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.194:40323: BlockingRecv error: recv got EOF from 127.12.202.194:40323 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:34.452453 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:34.447922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:46489)
0809 18:47:34.447973 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:34.447986 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:34.448029 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:34.448176 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:34.448177 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:34.448279 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:34.448372 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:34.448374 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.449307 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.449308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:34.449752 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:34.449753 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.450213 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.450214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:34.450247 (+ 33us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.450636 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:34.450641 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:34.452412 (+ 1771us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 18:47:34.452612 27974 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 18:47:34.452652 27766 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:34.447992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:46489 (local address 127.12.202.254:43279)
0809 18:47:34.448061 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:34.448063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:34.448073 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:47:34.448096 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:34.448097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:34.448107 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:34.448168 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:34.448449 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.449220 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.449829 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.450139 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.450216 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.452582 (+ 2366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.194:46489: BlockingRecv error: recv got EOF from 127.12.202.194:46489 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260809 18:47:34.526262 27977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:34.526453 27977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:34.526474 27977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:34.527511 27977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:34.527542 27977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:34.527567 27977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:47:34.528960 27977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/krb5kdc/oryx_127.12.202.195.keytab
--principal=oryx/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:33065
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=44171
--tserver_master_addrs=127.12.202.254:43279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:34.529138 27977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:34.529294 27977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:34.534364 27984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:34.534337 27985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:34.534320 27994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:34.534658 27977 server_base.cc:1034] running on GCE node
I20260809 18:47:34.534874 27977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:34.535112 27977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:34.536273 27977 hybrid_clock.cc:648] HybridClock initialized: now 1786301254536247 us; error 43 us; skew 500 ppm
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301254, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:47:34.538748 27977 init.cc:377] Logged in from keytab as oryx/127.12.202.195@KRBTEST.COM (short username oryx)
I20260809 18:47:34.539165 27977 webserver.cc:460] Webserver started at http://127.12.202.195:44171/ using document root <none> and password file <none>
I20260809 18:47:34.539397 27977 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:34.539479 27977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:34.540814 27977 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:47:34.541407 28009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:34.541561 27977 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:47:34.541688 27977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "8c669b75b25846778516a80c05f5d6e6"
format_stamp: "Formatted at 2026-08-09 18:47:33 on dist-test-slave-45dx"
server_key: "c2ecce51e4aafaea20714d6f9e18a26e"
server_key_iv: "cdc686bddfb22ae7cab39c586ac9ce40"
server_key_version: "encryptionkey@0"
I20260809 18:47:34.542016 27977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:34.559985 27977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:34.562284 27977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:34.562451 27977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:34.562672 27977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:47:34.562966 27977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:47:34.563020 27977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:34.563054 27977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:47:34.563081 27977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:34.569350 27977 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:33065
I20260809 18:47:34.569401 28192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:33065 every 8 connection(s)
I20260809 18:47:34.569765 27977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:34.577284 28195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:34.570534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.195:60679)
0809 18:47:34.570700 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:34.570736 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:34.571302 (+ 566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:34.571514 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:34.571517 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:34.572192 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:34.572440 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:34.572446 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.573133 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.573134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:34.573958 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:34.573960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.574281 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.574282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:34.574378 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.574835 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:34.574842 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:34.577137 (+ 2295us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":90,"threads_started":1}
W20260809 18:47:34.577284 27766 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:34.570538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:60679 (local address 127.12.202.254:43279)
0809 18:47:34.570607 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:34.570610 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:34.570831 (+ 221us) server_negotiation.cc:407] Connection header received
0809 18:47:34.571394 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:34.571395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:34.571406 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:34.571455 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:34.572517 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.573052 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.574032 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.574208 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.574259 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.577226 (+ 2967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.195:60679: BlockingRecv error: recv got EOF from 127.12.202.195:60679 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260809 18:47:34.577585 28193 heartbeater.cc:644] Failed to heartbeat to 127.12.202.254:43279 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.202.254:43279: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
I20260809 18:47:34.577808 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 27977
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:34.582670 28195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:34.577886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.195:33965)
0809 18:47:34.577939 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:34.577950 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:34.577989 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:34.578536 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:34.578537 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:34.578669 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:34.578714 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:34.578715 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.579376 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.579377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:34.579881 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:34.579882 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.580250 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.580250 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:34.580337 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.580790 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:34.580795 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:34.582622 (+ 1827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 18:47:34.582804 27766 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:34.578350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:33965 (local address 127.12.202.254:43279)
0809 18:47:34.578406 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:34.578407 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:34.578416 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:47:34.578438 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:34.578438 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:34.578447 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:34.578528 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:34.578832 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.579296 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.579974 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.580166 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.580247 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.582728 (+ 2481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.195:33965: BlockingRecv error: recv got EOF from 127.12.202.195:33965 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 18:47:34.585307 27768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:34.578388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34974 (local address 127.12.202.254:43279)
0809 18:47:34.578456 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:34.578458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:34.578468 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:47:34.578533 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:34.578535 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:34.578546 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:34.578618 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:34.579213 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.579675 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.580474 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.580662 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.580739 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.581988 (+ 1249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:34.581992 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:34.581992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:34.582004 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:34.583800 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:34.584190 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:34.584194 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:34.584194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:34.584349 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:34.584573 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:34.584574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:34.584575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:34.584819 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:34.584992 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:34.585098 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 18:47:34.585216 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:34 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:34.587553 28195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:34.583155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.195:36859)
0809 18:47:34.583206 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:34.583216 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:34.583254 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:34.583406 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:34.583407 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:34.583532 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:34.583556 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:34.583558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.584165 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.584166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:34.584718 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:34.584719 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.585089 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.585090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:34.585142 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.585814 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:34.585819 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:34.587505 (+ 1686us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 18:47:34.587690 28193 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 18:47:34.587796 27766 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:34.583225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:36859 (local address 127.12.202.254:43279)
0809 18:47:34.583278 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:34.583280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:34.583289 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:47:34.583310 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:34.583310 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:34.583319 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:34.583390 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:34.583630 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.584086 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.584821 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:34.585006 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:34.585087 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:34.587589 (+ 2502us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.195:36859: BlockingRecv error: recv got EOF from 127.12.202.195:36859 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 09 18:47:35 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:35 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:35.321097 28197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:35.316247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:53363)
0809 18:47:35.316445 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:35.316456 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:35.316517 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:35.316657 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:35.316658 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:35.316836 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:35.316888 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:35.316889 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:35.317495 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:35.317496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:35.318047 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:35.318049 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:35.318372 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:35.318373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:35.318412 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:35.319047 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:35.319053 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:35.321028 (+ 1975us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":111,"threads_started":1}
W20260809 18:47:35.321201 28198 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:35.316369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:53363 (local address 127.12.202.254:43279)
0809 18:47:35.316490 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:35.316494 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:35.316504 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:47:35.316565 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:35.316566 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:35.316576 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:35.316635 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:35.316949 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:35.317431 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:35.318115 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:35.318307 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:35.318359 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:35.321123 (+ 2764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.193:53363: BlockingRecv error: recv got EOF from 127.12.202.193:53363 (error 108)
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":65,"threads_started":1}
Aug 09 18:47:35 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:35 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:35.457537 28199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:35.453047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:43765)
0809 18:47:35.453202 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:35.453219 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:35.453277 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:35.453407 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:35.453408 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:35.453570 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:35.453618 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:35.453620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:35.454233 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:35.454234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:35.454748 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:35.454749 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:35.455165 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:35.455166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:35.455215 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:35.455668 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:35.455673 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:35.457471 (+ 1798us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":94,"threads_started":1}
W20260809 18:47:35.457626 28198 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:35.453116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:43765 (local address 127.12.202.254:43279)
0809 18:47:35.453173 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:35.453175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:35.453283 (+ 108us) server_negotiation.cc:407] Connection header received
0809 18:47:35.453330 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:35.453331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:35.453342 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:35.453384 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:35.453681 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:35.454171 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:35.454876 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:35.455089 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:35.455152 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:35.457559 (+ 2407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.194:43765: BlockingRecv error: recv got EOF from 127.12.202.194:43765 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 09 18:47:35 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:35 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:35.593075 28201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:35.588232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.195:58845)
0809 18:47:35.588407 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:35.588419 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:35.588497 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:35.588626 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:35.588626 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:35.588793 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:35.588844 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:35.588846 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:35.589722 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:35.589723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:35.590328 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:35.590330 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:35.590672 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:35.590673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:35.590713 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:35.591143 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:35.591148 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:35.593002 (+ 1854us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":117,"threads_started":1}
W20260809 18:47:35.593166 28198 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:35.588325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:58845 (local address 127.12.202.254:43279)
0809 18:47:35.588394 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:35.588396 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:35.588494 (+ 98us) server_negotiation.cc:407] Connection header received
0809 18:47:35.588542 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:35.588542 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:35.588556 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:35.588605 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:35.588921 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:35.589621 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:35.590408 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:35.590596 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:35.590650 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:35.593099 (+ 2449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.195:58845: BlockingRecv error: recv got EOF from 127.12.202.195:58845 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 09 18:47:36 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:36 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:36.326694 28202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:36.321626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:50297)
0809 18:47:36.321836 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:36.321847 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:36.321905 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:36.322040 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:36.322041 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:36.322210 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:36.322264 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:36.322265 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:36.322902 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:36.322903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:36.323447 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:36.323449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:36.323814 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:36.323815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:36.323868 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:36.324490 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:36.324495 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:36.326565 (+ 2070us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":95,"threads_started":1}
W20260809 18:47:36.326751 28203 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:36.321751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:50297 (local address 127.12.202.254:43279)
0809 18:47:36.321887 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:36.321889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:36.321898 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:47:36.321954 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:36.321954 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:36.321967 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:36.322025 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:36.322330 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:36.322830 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:36.323522 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:36.323713 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:36.323763 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:36.326673 (+ 2910us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.193:50297: BlockingRecv error: recv got EOF from 127.12.202.193:50297 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":65,"threads_started":1}
Aug 09 18:47:36 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:36 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:36.463008 28204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:36.458151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:48847)
0809 18:47:36.458347 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:36.458358 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:36.458438 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:36.458597 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:36.458598 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:36.458780 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:36.458849 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:36.458851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:36.459504 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:36.459505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:36.460049 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:36.460050 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:36.460468 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:36.460469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:36.460533 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:36.461006 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:36.461015 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:36.462899 (+ 1884us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":98,"threads_started":1}
W20260809 18:47:36.463053 28203 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:36.458239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:48847 (local address 127.12.202.254:43279)
0809 18:47:36.458331 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:36.458333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:36.458419 (+ 86us) server_negotiation.cc:407] Connection header received
0809 18:47:36.458508 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:36.458509 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:36.458520 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:36.458590 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:36.458927 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:36.459416 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:36.460128 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:36.460372 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:36.460464 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:36.462992 (+ 2528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.194:48847: BlockingRecv error: recv got EOF from 127.12.202.194:48847 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 09 18:47:36 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:36 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:36.598014 28206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:36.593587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.195:35931)
0809 18:47:36.593755 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:36.593769 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:36.593840 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:36.593996 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:36.593997 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:36.594164 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:36.594214 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:36.594216 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:36.594815 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:36.594815 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:36.595327 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:36.595328 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:36.595633 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:36.595634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:36.595671 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:36.596107 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:36.596112 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:36.597957 (+ 1845us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":69,"threads_started":1}
W20260809 18:47:36.598145 28203 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:36.593731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:35931 (local address 127.12.202.254:43279)
0809 18:47:36.593792 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:36.593794 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:36.593824 (+ 30us) server_negotiation.cc:407] Connection header received
0809 18:47:36.593898 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:36.593899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:36.593912 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:36.593959 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:36.594274 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:36.594750 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:36.595396 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:36.595570 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:36.595620 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:36.598072 (+ 2452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.195:35931: BlockingRecv error: recv got EOF from 127.12.202.195:35931 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 09 18:47:37 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:37 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:37.332360 28208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:37.327221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:54309)
0809 18:47:37.327373 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:37.327391 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:37.327456 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:37.327591 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:37.327592 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:37.327771 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:37.327825 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:37.327826 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:37.328790 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:37.328791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:37.329420 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:37.329422 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:37.329771 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:37.329771 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:37.329815 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:37.330384 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:37.330390 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:37.332246 (+ 1856us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":98,"threads_started":1}
W20260809 18:47:37.332494 28209 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:37.327316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:54309 (local address 127.12.202.254:43279)
0809 18:47:37.327453 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:37.327457 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:37.327472 (+ 15us) server_negotiation.cc:407] Connection header received
0809 18:47:37.327496 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:37.327497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:37.327507 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:37.327575 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:37.327967 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:37.328706 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:37.329498 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:37.329700 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:37.329751 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:37.332393 (+ 2642us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.193:54309: BlockingRecv error: recv got EOF from 127.12.202.193:54309 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":84,"threads_started":1}
Aug 09 18:47:37 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:37 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:37.467911 28211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:37.463509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:38147)
0809 18:47:37.463635 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:37.463645 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:37.463713 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:37.463836 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:37.463837 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:37.464010 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:37.464060 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:37.464062 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:37.464771 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:37.464772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:37.465276 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:37.465277 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:37.465585 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:37.465586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:37.465625 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:37.466051 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:37.466056 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:37.467852 (+ 1796us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":76,"threads_started":1}
W20260809 18:47:37.468046 28209 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:37.463592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:38147 (local address 127.12.202.254:43279)
0809 18:47:37.463643 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:37.463645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:37.463703 (+ 58us) server_negotiation.cc:407] Connection header received
0809 18:47:37.463755 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:37.463755 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:37.463766 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:37.463819 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:37.464123 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:37.464703 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:37.465342 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:37.465523 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:37.465572 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:37.467963 (+ 2391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.194:38147: BlockingRecv error: recv got EOF from 127.12.202.194:38147 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 09 18:47:37 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:37 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:37.602792 28212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:37.598528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.195:32971)
0809 18:47:37.598667 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:37.598680 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:37.598744 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:37.598870 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:37.598870 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:37.599028 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:37.599075 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:37.599076 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:37.599676 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:37.599677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:37.600155 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:37.600156 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:37.600497 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:37.600498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:37.600535 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:37.600952 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:37.600957 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:37.602733 (+ 1776us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":67,"threads_started":1}
W20260809 18:47:37.602900 28209 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:37.598580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:32971 (local address 127.12.202.254:43279)
0809 18:47:37.598672 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:37.598674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:37.598742 (+ 68us) server_negotiation.cc:407] Connection header received
0809 18:47:37.598785 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:37.598786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:37.598798 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:37.598846 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:37.599132 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:37.599594 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:37.600239 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:37.600425 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:37.600485 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:37.602824 (+ 2339us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.195:32971: BlockingRecv error: recv got EOF from 127.12.202.195:32971 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 09 18:47:38 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:38 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:38.337766 28214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:38.332816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:48647)
0809 18:47:38.332956 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:38.332967 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:38.333030 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:38.333218 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:38.333218 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:38.333454 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:38.333508 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:38.333511 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:38.334242 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:38.334243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:38.334880 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:38.334883 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:38.335263 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:38.335264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:38.335321 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:38.335888 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:38.335893 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:38.337706 (+ 1813us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":85,"threads_started":1}
W20260809 18:47:38.337896 28215 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:38.332878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:48647 (local address 127.12.202.254:43279)
0809 18:47:38.333011 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:38.333013 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:38.333022 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:47:38.333086 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:38.333086 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:38.333098 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:38.333213 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:38.333580 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:38.334135 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:38.334989 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:38.335193 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:38.335250 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:38.337808 (+ 2558us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.193:48647: BlockingRecv error: recv got EOF from 127.12.202.193:48647 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":77,"threads_started":1}
Aug 09 18:47:38 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:38 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:38.478930 28216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:38.468433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:46807)
0809 18:47:38.468564 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:38.468580 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:38.468642 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:38.468757 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:38.468757 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:38.468924 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:38.468972 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:38.468973 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:38.469556 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:38.469556 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:38.470045 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:38.470046 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:38.470380 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:38.470381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:38.470419 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:38.477032 (+ 6613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:38.477037 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:38.478874 (+ 1837us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":57,"threads_started":1}
W20260809 18:47:38.479087 28215 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:38.468510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:46807 (local address 127.12.202.254:43279)
0809 18:47:38.468563 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:38.468565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:38.468626 (+ 61us) server_negotiation.cc:407] Connection header received
0809 18:47:38.468691 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:38.468692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:38.468702 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:38.468740 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:38.469036 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:38.469493 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:38.470129 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:38.470315 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:38.470377 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:38.479004 (+ 8627us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.194:46807: BlockingRecv error: recv got EOF from 127.12.202.194:46807 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 09 18:47:38 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:38 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:38.608687 28218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:38.603319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.195:40911)
0809 18:47:38.603507 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:38.603518 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:38.603615 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:38.603800 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:38.603801 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:38.603986 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:38.604033 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:38.604035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:38.604987 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:38.604988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:38.605543 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:38.605545 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:38.605989 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:38.605990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:38.606040 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:38.606496 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:38.606500 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:38.608565 (+ 2065us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":107,"threads_started":1}
W20260809 18:47:38.608780 28215 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:38.603402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:40911 (local address 127.12.202.254:43279)
0809 18:47:38.603486 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:38.603488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:38.603595 (+ 107us) server_negotiation.cc:407] Connection header received
0809 18:47:38.603715 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:38.603716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:38.603729 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:38.603790 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:38.604119 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:38.604893 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:38.605665 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:38.605900 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:38.605960 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:38.608694 (+ 2734us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.195:40911: BlockingRecv error: recv got EOF from 127.12.202.195:40911 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 09 18:47:39 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:39 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:39.343330 28220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:39.338337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:55679)
0809 18:47:39.338485 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:39.338497 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:39.338556 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:39.338720 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:39.338721 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:39.338915 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:39.338971 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:39.338973 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:39.339673 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:39.339674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:39.340275 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:39.340276 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:39.340670 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:39.340671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:39.340719 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:39.341210 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:39.341215 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:39.343219 (+ 2004us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":88,"threads_started":1}
W20260809 18:47:39.343474 28221 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:39.338398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:55679 (local address 127.12.202.254:43279)
0809 18:47:39.338554 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:39.338556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:39.338566 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:47:39.338594 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:39.338595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:39.338605 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:39.338672 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:39.339072 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:39.339589 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:39.340393 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:39.340596 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:39.340655 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:39.343337 (+ 2682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.193:55679: BlockingRecv error: recv got EOF from 127.12.202.193:55679 (error 108)
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":97,"threads_started":1}
Aug 09 18:47:39 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:39 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:39.484191 28223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:39.479390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:34453)
0809 18:47:39.479540 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:39.479551 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:39.479611 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:39.479732 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:39.479733 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:39.479913 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:39.479963 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:39.479964 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:39.480664 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:39.480665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:39.481222 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:39.481223 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:39.481576 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:39.481577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:39.481621 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:39.482143 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:39.482147 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:39.484130 (+ 1983us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":60,"threads_started":1}
W20260809 18:47:39.484416 28221 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:39.479541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:34453 (local address 127.12.202.254:43279)
0809 18:47:39.479606 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:39.479608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:39.479617 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:47:39.479660 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:39.479661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:39.479672 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:39.479710 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:39.480029 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:39.480561 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:39.481307 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:39.481505 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:39.481559 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:39.484274 (+ 2715us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.194:34453: BlockingRecv error: recv got EOF from 127.12.202.194:34453 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 09 18:47:39 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:39 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:39.613876 28224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:39.609180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.195:57215)
0809 18:47:39.609319 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:39.609332 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:39.609399 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:39.609537 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:39.609537 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:39.609709 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:39.609781 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:39.609783 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:39.610426 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:39.610427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:39.610954 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:39.610956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:39.611288 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:39.611289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:39.611330 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:39.611789 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:39.611794 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:39.613774 (+ 1980us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":81,"threads_started":1}
W20260809 18:47:39.613927 28221 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:39.609273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:57215 (local address 127.12.202.254:43279)
0809 18:47:39.609350 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:39.609352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:39.609383 (+ 31us) server_negotiation.cc:407] Connection header received
0809 18:47:39.609450 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:39.609450 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:39.609463 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:39.609523 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:39.609869 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:39.610358 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:39.611034 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:39.611218 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:39.611273 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:39.613860 (+ 2587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.195:57215: BlockingRecv error: recv got EOF from 127.12.202.195:57215 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 09 18:47:40 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:40 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:40.349481 28225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:40.343995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:51405)
0809 18:47:40.344207 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:40.344226 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:40.344288 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:40.344549 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:40.344550 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:40.344805 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:40.344958 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:40.344962 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:40.345931 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:40.345932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:40.346463 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:40.346465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:40.346809 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:40.346809 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:40.346872 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:40.347346 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:40.347350 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:40.349414 (+ 2064us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":111,"threads_started":1}
W20260809 18:47:40.349706 28226 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:40.344124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:51405 (local address 127.12.202.254:43279)
0809 18:47:40.344264 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:40.344266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:40.344278 (+ 12us) server_negotiation.cc:407] Connection header received
0809 18:47:40.344414 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:40.344415 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:40.344431 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:40.344535 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:40.345079 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:40.345850 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:40.346541 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:40.346727 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:40.346803 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:40.349550 (+ 2747us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.193:51405: BlockingRecv error: recv got EOF from 127.12.202.193:51405 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
Aug 09 18:47:40 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:40 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:40.489347 28227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:40.484824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:38495)
0809 18:47:40.485066 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:40.485079 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:40.485154 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:40.485271 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:40.485272 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:40.485448 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:40.485498 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:40.485499 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:40.486123 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:40.486124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:40.486647 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:40.486649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:40.486977 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:40.486978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:40.487020 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:40.487464 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:40.487468 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:40.489288 (+ 1820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":174,"threads_started":1}
W20260809 18:47:40.489493 28226 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:40.484909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:38495 (local address 127.12.202.254:43279)
0809 18:47:40.485010 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:40.485012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:40.485159 (+ 147us) server_negotiation.cc:407] Connection header received
0809 18:47:40.485202 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:40.485203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:40.485215 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:40.485269 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:40.485559 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:40.486053 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:40.486719 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:40.486913 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:40.486961 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:40.489406 (+ 2445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.194:38495: BlockingRecv error: recv got EOF from 127.12.202.194:38495 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 09 18:47:40 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:40 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:40.618983 28231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:40.614465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.195:46387)
0809 18:47:40.614591 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:40.614600 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:40.614657 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:40.614769 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:40.614769 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:40.614954 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:40.615017 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:40.615018 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:40.615650 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:40.615651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:40.616201 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:40.616203 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:40.616621 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:40.616622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:40.616666 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:40.617122 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:40.617127 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:40.618921 (+ 1794us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":70,"threads_started":1}
W20260809 18:47:40.619086 28226 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:40.614516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:46387 (local address 127.12.202.254:43279)
0809 18:47:40.614588 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:40.614590 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:40.614643 (+ 53us) server_negotiation.cc:407] Connection header received
0809 18:47:40.614699 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:40.614700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:40.614713 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:40.614763 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:40.615094 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:40.615580 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:40.616292 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:40.616548 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:40.616607 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:40.619016 (+ 2409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.195:46387: BlockingRecv error: recv got EOF from 127.12.202.195:46387 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 18:47:41 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:41 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:41.354897 28232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:41.350032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:37845)
0809 18:47:41.350195 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:41.350207 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:41.350274 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:41.350407 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:41.350408 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:41.350591 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:41.350644 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:41.350645 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:41.351295 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:41.351296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:41.351873 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:41.351875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:41.352226 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:41.352226 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:41.352277 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:41.352810 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:41.352815 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:41.354782 (+ 1967us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":94,"threads_started":1}
W20260809 18:47:41.354956 28233 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:41.350119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:37845 (local address 127.12.202.254:43279)
0809 18:47:41.350229 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:41.350231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:41.350258 (+ 27us) server_negotiation.cc:407] Connection header received
0809 18:47:41.350319 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:41.350319 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:41.350330 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:41.350386 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:41.350712 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:41.351198 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:41.351951 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:41.352137 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:41.352205 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:41.354880 (+ 2675us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.193:37845: BlockingRecv error: recv got EOF from 127.12.202.193:37845 (error 108)
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":55,"threads_started":1}
Aug 09 18:47:41 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:41 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:41.494454 28235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:41.489764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:38167)
0809 18:47:41.489954 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:41.489967 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:41.490033 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:41.490164 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:41.490165 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:41.490355 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:41.490409 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:41.490411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:41.491074 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:41.491075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:41.491600 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:41.491602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:41.491980 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:41.491981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:41.492040 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:41.492544 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:41.492548 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:41.494357 (+ 1809us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":104,"threads_started":1}
W20260809 18:47:41.494534 28233 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:41.489885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:38167 (local address 127.12.202.254:43279)
0809 18:47:41.489958 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:41.489960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:41.490013 (+ 53us) server_negotiation.cc:407] Connection header received
0809 18:47:41.490088 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:41.490088 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:41.490102 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:41.490146 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:41.490491 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:41.490990 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:41.491688 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:41.491905 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:41.491981 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:41.494456 (+ 2475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.194:38167: BlockingRecv error: recv got EOF from 127.12.202.194:38167 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 18:47:41 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:41 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:41.624131 28236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:41.619519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.195:38457)
0809 18:47:41.619689 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:41.619699 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:41.619763 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:41.619902 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:41.619903 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:41.620078 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:41.620129 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:41.620131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:41.620844 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:41.620845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:41.621371 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:41.621372 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:41.621684 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:41.621685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:41.621723 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:41.622258 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:41.622263 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:41.624054 (+ 1791us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":96,"threads_started":1}
W20260809 18:47:41.624243 28233 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:41.619580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:38457 (local address 127.12.202.254:43279)
0809 18:47:41.619651 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:41.619653 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:41.619763 (+ 110us) server_negotiation.cc:407] Connection header received
0809 18:47:41.619822 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:41.619822 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:41.619836 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:41.619883 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:41.620194 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:41.620773 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:41.621439 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:41.621621 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:41.621672 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:41.624143 (+ 2471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.195:38457: BlockingRecv error: recv got EOF from 127.12.202.195:38457 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 18:47:42 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:42 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:42.360632 28238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:42.355534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:45803)
0809 18:47:42.355676 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:42.355687 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:42.355765 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:42.356052 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:42.356053 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:42.356223 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:42.356275 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:42.356276 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:42.357022 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:42.357023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:42.357538 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:42.357540 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:42.357874 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:42.357875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:42.357918 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:42.358386 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:42.358391 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:42.360521 (+ 2130us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":83,"threads_started":1}
W20260809 18:47:42.360674 28239 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:42.355759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:45803 (local address 127.12.202.254:43279)
0809 18:47:42.355920 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:42.355922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:42.355930 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:47:42.355953 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:42.355954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:42.355964 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:42.356030 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:42.356452 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:42.356952 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:42.357605 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:42.357808 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:42.357863 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:42.360601 (+ 2738us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.193:45803: BlockingRecv error: recv got EOF from 127.12.202.193:45803 (error 108)
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":80,"threads_started":1}
Aug 09 18:47:42 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:42 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:42.499629 28240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:42.494913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:59957)
0809 18:47:42.495064 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:42.495076 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:42.495138 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:42.495301 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:42.495302 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:42.495468 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:42.495519 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:42.495520 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:42.496363 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:42.496364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:42.496905 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:42.496907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:42.497292 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:42.497293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:42.497332 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:42.497784 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:42.497789 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:42.499570 (+ 1781us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":96,"threads_started":1}
W20260809 18:47:42.499747 28239 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:42.495029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:59957 (local address 127.12.202.254:43279)
0809 18:47:42.495100 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:42.495103 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:42.495125 (+ 22us) server_negotiation.cc:407] Connection header received
0809 18:47:42.495200 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:42.495201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:42.495212 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:42.495283 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:42.495578 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:42.496238 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:42.497001 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:42.497217 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:42.497282 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:42.499668 (+ 2386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.194:59957: BlockingRecv error: recv got EOF from 127.12.202.194:59957 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 09 18:47:42 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:42 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:42.629209 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:42.624671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.195:33021)
0809 18:47:42.624811 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:42.624828 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:42.624871 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:42.624990 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:42.624990 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:42.625155 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:42.625202 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:42.625204 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:42.625951 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:42.625952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:42.626477 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:42.626478 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:42.626846 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:42.626846 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:42.626886 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:42.627355 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:42.627359 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:42.629151 (+ 1792us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":58,"threads_started":1}
W20260809 18:47:42.629359 28239 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:42.624782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:33021 (local address 127.12.202.254:43279)
0809 18:47:42.624843 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:42.624845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:42.624865 (+ 20us) server_negotiation.cc:407] Connection header received
0809 18:47:42.624915 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:42.624916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:42.624930 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:42.624988 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:42.625265 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:42.625869 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:42.626555 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:42.626776 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:42.626828 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:42.629270 (+ 2442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.195:33021: BlockingRecv error: recv got EOF from 127.12.202.195:33021 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 09 18:47:43 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:43 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:43.365785 28242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:43.361099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:34187)
0809 18:47:43.361263 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:43.361282 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:43.361341 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:43.361453 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:43.361454 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:43.361624 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:43.361675 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:43.361676 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:43.362335 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:43.362335 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:43.362857 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:43.362859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:43.363207 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:43.363208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:43.363255 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:43.363788 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:43.363798 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:43.365727 (+ 1929us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":95,"threads_started":1}
W20260809 18:47:43.365924 28243 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:43.361175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:34187 (local address 127.12.202.254:43279)
0809 18:47:43.361280 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:43.361281 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:43.361343 (+ 62us) server_negotiation.cc:407] Connection header received
0809 18:47:43.361384 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:43.361384 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:43.361394 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:43.361449 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:43.361733 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:43.362261 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:43.362932 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:43.363131 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:43.363183 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:43.365814 (+ 2631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.193:34187: BlockingRecv error: recv got EOF from 127.12.202.193:34187 (error 108)
Metrics: {"server-negotiator.queue_time_us":76,"thread_start_us":48,"threads_started":1}
Aug 09 18:47:43 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:43 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:43.509013 28246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:43.500152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:56209)
0809 18:47:43.500279 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:43.500313 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:43.500399 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:43.500514 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:43.500515 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:43.500689 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:43.500741 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:43.500742 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:43.501358 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:43.501359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:43.501920 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:43.501922 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:43.502266 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:43.502267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:43.502309 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:43.506713 (+ 4404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:43.506718 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:43.508923 (+ 2205us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":71,"threads_started":1}
W20260809 18:47:43.509037 28243 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:43.500227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:56209 (local address 127.12.202.254:43279)
0809 18:47:43.500292 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:43.500294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:43.500397 (+ 103us) server_negotiation.cc:407] Connection header received
0809 18:47:43.500445 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:43.500446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:43.500457 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:43.500509 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:43.500806 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:43.501289 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:43.501994 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:43.502197 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:43.502249 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:43.508989 (+ 6740us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.194:56209: BlockingRecv error: recv got EOF from 127.12.202.194:56209 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 09 18:47:43 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:43 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:43.634464 28249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:43.629736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.195:53251)
0809 18:47:43.629889 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:43.629900 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:43.629965 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:43.630096 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:43.630097 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:43.630292 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:43.630344 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:43.630346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:43.630972 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:43.630973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:43.631525 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:43.631526 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:43.631841 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:43.631842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:43.631881 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:43.632357 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:43.632362 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:43.634365 (+ 2003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":89,"threads_started":1}
W20260809 18:47:43.634506 28243 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:43.629863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:53251 (local address 127.12.202.254:43279)
0809 18:47:43.629911 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:43.629913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:43.629956 (+ 43us) server_negotiation.cc:407] Connection header received
0809 18:47:43.630018 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:43.630019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:43.630033 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:43.630073 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:43.630412 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:43.630899 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:43.631597 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:43.631776 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:43.631829 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:43.634443 (+ 2614us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.195:53251: BlockingRecv error: recv got EOF from 127.12.202.195:53251 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 09 18:47:44 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:44 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:44.370833 28250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:44.366212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:38991)
0809 18:47:44.366410 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:44.366423 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:44.366498 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:44.366630 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:44.366631 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:44.366794 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:44.366847 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:44.366849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:44.367491 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:44.367492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:44.367988 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:44.367990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:44.368392 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:44.368393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:44.368454 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:44.368892 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:44.368896 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:44.370744 (+ 1848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":99,"threads_started":1}
W20260809 18:47:44.370903 28251 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:44.366285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:38991 (local address 127.12.202.254:43279)
0809 18:47:44.366408 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:44.366410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:44.366488 (+ 78us) server_negotiation.cc:407] Connection header received
0809 18:47:44.366545 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:44.366546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:44.366556 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:44.366615 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:44.366911 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:44.367380 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:44.368076 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:44.368282 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:44.368389 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:44.370850 (+ 2461us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.193:38991: BlockingRecv error: recv got EOF from 127.12.202.193:38991 (error 108)
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":49,"threads_started":1}
Aug 09 18:47:44 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:44 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:44.514221 28252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:44.509495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:49667)
0809 18:47:44.509630 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:44.509640 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:44.509697 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:44.509880 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:44.509881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:44.510064 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:44.510110 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:44.510112 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:44.510714 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:44.510714 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:44.511225 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:44.511226 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:44.511585 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:44.511587 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:44.511640 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:44.512120 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:44.512125 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:44.514161 (+ 2036us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":58,"threads_started":1}
W20260809 18:47:44.514293 28251 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:44.509576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:49667 (local address 127.12.202.254:43279)
0809 18:47:44.509625 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:44.509628 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:44.509699 (+ 71us) server_negotiation.cc:407] Connection header received
0809 18:47:44.509746 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:44.509747 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:44.509759 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:44.509820 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:44.510177 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:44.510650 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:44.511296 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:44.511474 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:44.511524 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:44.514245 (+ 2721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.194:49667: BlockingRecv error: recv got EOF from 127.12.202.194:49667 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 09 18:47:44 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:44 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:44.640012 28254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:44.635092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.195:42709)
0809 18:47:44.635268 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:44.635282 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:44.635354 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:44.635534 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:44.635536 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:44.635711 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:44.635766 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:44.635768 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:44.636482 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:44.636483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:44.637042 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:44.637044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:44.637474 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:44.637475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:44.637520 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:44.638061 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:44.638067 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:44.639951 (+ 1884us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":77,"threads_started":1}
W20260809 18:47:44.640149 28251 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:44.635235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:42709 (local address 127.12.202.254:43279)
0809 18:47:44.635304 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:44.635307 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:44.635333 (+ 26us) server_negotiation.cc:407] Connection header received
0809 18:47:44.635412 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:44.635412 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:44.635425 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:44.635478 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:44.635843 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:44.636387 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:44.637140 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:44.637381 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:44.637448 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:44.640069 (+ 2621us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.195:42709: BlockingRecv error: recv got EOF from 127.12.202.195:42709 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 09 18:47:45 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:45 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:45.376466 28256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:45.371360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:58113)
0809 18:47:45.371552 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:45.371562 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:45.371615 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:45.371809 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:45.371811 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:45.372044 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:45.372094 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:45.372096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:45.372964 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:45.372964 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:45.373507 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:45.373509 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:45.373844 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:45.373845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:45.373885 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:45.374424 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:45.374429 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:45.376398 (+ 1969us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":102,"threads_started":1}
W20260809 18:47:45.376585 28257 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:45.371435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:58113 (local address 127.12.202.254:43279)
0809 18:47:45.371556 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:45.371558 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:45.371603 (+ 45us) server_negotiation.cc:407] Connection header received
0809 18:47:45.371668 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:45.371668 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:45.371679 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:45.371739 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:45.372170 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:45.372887 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:45.373582 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:45.373773 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:45.373831 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:45.376500 (+ 2669us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.193:58113: BlockingRecv error: recv got EOF from 127.12.202.193:58113 (error 108)
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":71,"threads_started":1}
Aug 09 18:47:45 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:45 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:45.520064 28259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:45.514737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:33189)
0809 18:47:45.514883 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:45.514895 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:45.514962 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:45.515116 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:45.515118 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:45.515377 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:45.515441 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:45.515443 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:45.516076 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:45.516077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:45.517050 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:45.517054 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:45.517408 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:45.517409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:45.517476 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:45.517959 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:45.517964 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:45.519947 (+ 1983us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":77,"threads_started":1}
W20260809 18:47:45.520160 28257 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:45.514790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:33189 (local address 127.12.202.254:43279)
0809 18:47:45.514860 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:45.514862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:45.514958 (+ 96us) server_negotiation.cc:407] Connection header received
0809 18:47:45.515027 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:45.515028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:45.515039 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:45.515087 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:45.515509 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:45.516000 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:45.517134 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:45.517331 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:45.517384 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:45.520074 (+ 2690us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.194:33189: BlockingRecv error: recv got EOF from 127.12.202.194:33189 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 09 18:47:45 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:45 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:45.645217 28260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:45.640477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.195:42323)
0809 18:47:45.640662 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:45.640671 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:45.640724 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:45.640882 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:45.640883 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:45.641065 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:45.641120 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:45.641122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:45.641802 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:45.641802 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:45.642334 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:45.642335 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:45.642662 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:45.642663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:45.642701 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:45.643182 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:45.643187 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:45.645097 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":110,"threads_started":1}
W20260809 18:47:45.645300 28257 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:45.640549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:42323 (local address 127.12.202.254:43279)
0809 18:47:45.640593 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:45.640595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:45.640710 (+ 115us) server_negotiation.cc:407] Connection header received
0809 18:47:45.640783 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:45.640783 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:45.640797 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:45.640840 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:45.641188 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:45.641694 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:45.642408 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:45.642595 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:45.642646 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:45.645231 (+ 2585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.195:42323: BlockingRecv error: recv got EOF from 127.12.202.195:42323 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 09 18:47:46 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:46 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:46.381770 28262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:46.377033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:35787)
0809 18:47:46.377207 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:46.377229 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:46.377299 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:46.377438 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:46.377439 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:46.377628 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:46.377676 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:46.377678 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:46.378286 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:46.378286 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:46.378808 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:46.378810 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:46.379232 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:46.379233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:46.379287 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:46.379869 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:46.379874 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:46.381697 (+ 1823us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":74,"threads_started":1}
W20260809 18:47:46.381886 28263 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:46.377146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:35787 (local address 127.12.202.254:43279)
0809 18:47:46.377285 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:46.377287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:46.377295 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:47:46.377355 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:46.377356 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:46.377367 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:46.377416 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:46.377741 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:46.378219 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:46.378879 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:46.379092 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:46.379140 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:46.381809 (+ 2669us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.193:35787: BlockingRecv error: recv got EOF from 127.12.202.193:35787 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":71,"threads_started":1}
Aug 09 18:47:46 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:46 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:46.525331 28264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:46.520612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:49093)
0809 18:47:46.520758 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:46.520768 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:46.520822 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:46.520951 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:46.520952 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:46.521121 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:46.521167 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:46.521168 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:46.521808 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:46.521809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:46.522369 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:46.522371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:46.522707 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:46.522708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:46.522749 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:46.523207 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:46.523211 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:46.525261 (+ 2050us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
W20260809 18:47:46.525400 28263 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:46.520685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:49093 (local address 127.12.202.254:43279)
0809 18:47:46.520755 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:46.520757 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:46.520809 (+ 52us) server_negotiation.cc:407] Connection header received
0809 18:47:46.520870 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:46.520871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:46.520881 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:46.520929 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:46.521224 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:46.521709 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:46.522445 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:46.522638 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:46.522691 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:46.525354 (+ 2663us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.194:49093: BlockingRecv error: recv got EOF from 127.12.202.194:49093 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 09 18:47:46 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:46 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:46.650162 28265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:46.645718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.195:43707)
0809 18:47:46.645882 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:46.645893 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:46.645957 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:46.646097 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:46.646097 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:46.646282 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:46.646332 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:46.646333 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:46.646939 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:46.646940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:46.647453 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:46.647455 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:46.647758 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:46.647759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:46.647797 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:46.648349 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:46.648354 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:46.650095 (+ 1741us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":82,"threads_started":1}
W20260809 18:47:46.650254 28263 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:46.645818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:43707 (local address 127.12.202.254:43279)
0809 18:47:46.645908 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:46.645910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:46.645943 (+ 33us) server_negotiation.cc:407] Connection header received
0809 18:47:46.646013 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:46.646014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:46.646027 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:46.646075 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:46.646392 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:46.646876 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:46.647523 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:46.647698 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:46.647745 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:46.650186 (+ 2441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.195:43707: BlockingRecv error: recv got EOF from 127.12.202.195:43707 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 18:47:47 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:47 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:47.387125 28266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:47.382372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:43177)
0809 18:47:47.382634 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:47.382644 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:47.382705 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:47.382825 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:47.382825 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:47.383002 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:47.383050 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:47.383051 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:47.383688 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:47.383689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:47.384251 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:47.384253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:47.384632 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:47.384633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:47.384675 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:47.385159 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:47.385164 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:47.387047 (+ 1883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":199,"threads_started":1}
W20260809 18:47:47.387246 28270 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:47.382552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:43177 (local address 127.12.202.254:43279)
0809 18:47:47.382664 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:47.382665 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:47.382689 (+ 24us) server_negotiation.cc:407] Connection header received
0809 18:47:47.382759 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:47.382760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:47.382771 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:47.382836 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:47.383116 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:47.383613 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:47.384363 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:47.384566 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:47.384619 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:47.387141 (+ 2522us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.193:43177: BlockingRecv error: recv got EOF from 127.12.202.193:43177 (error 108)
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":55,"threads_started":1}
Aug 09 18:47:47 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:47 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:47.531118 28275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:47.525861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:33127)
0809 18:47:47.526019 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:47.526033 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:47.526148 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:47.526329 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:47.526330 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:47.526556 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:47.526614 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:47.526616 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:47.527613 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:47.527615 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:47.528370 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:47.528374 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:47.528676 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:47.528677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:47.528714 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:47.529208 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:47.529212 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:47.531059 (+ 1847us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":99,"threads_started":1}
W20260809 18:47:47.531265 28270 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:47.526018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:33127 (local address 127.12.202.254:43279)
0809 18:47:47.526067 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:47.526069 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:47.526139 (+ 70us) server_negotiation.cc:407] Connection header received
0809 18:47:47.526206 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:47.526207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:47.526222 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:47.526283 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:47.526681 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:47.527482 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:47.528430 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:47.528607 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:47.528664 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:47.531169 (+ 2505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.194:33127: BlockingRecv error: recv got EOF from 127.12.202.194:33127 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 09 18:47:47 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:47 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:47.655419 28276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:47.650649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.195:38321)
0809 18:47:47.650844 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:47.650858 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:47.650948 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:47.651122 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:47.651123 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:47.651325 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:47.651397 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:47.651399 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:47.652083 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:47.652085 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:47.652630 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:47.652632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:47.653034 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:47.653036 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:47.653097 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:47.653547 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:47.653551 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:47.655362 (+ 1811us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":94,"threads_started":1}
W20260809 18:47:47.655565 28270 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:47.650761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:38321 (local address 127.12.202.254:43279)
0809 18:47:47.650855 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:47.650858 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:47.650925 (+ 67us) server_negotiation.cc:407] Connection header received
0809 18:47:47.651021 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:47.651022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:47.651038 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:47.651116 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:47.651483 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:47.651986 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:47.652726 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:47.652946 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:47.653031 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:47.655476 (+ 2445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.195:38321: BlockingRecv error: recv got EOF from 127.12.202.195:38321 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 09 18:47:48 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:48 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:48.392678 28279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:48.387663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:44877)
0809 18:47:48.387865 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:48.387881 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:48.387956 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:48.388103 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:48.388104 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:48.388287 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:48.388376 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:48.388377 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:48.389046 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:48.389047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:48.389574 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:48.389576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:48.389985 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:48.389987 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:48.390053 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:48.390572 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:48.390577 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:48.392585 (+ 2008us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":77,"threads_started":1}
W20260809 18:47:48.392953 28280 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:48.387735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:44877 (local address 127.12.202.254:43279)
0809 18:47:48.387946 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:48.387948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:48.387957 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:47:48.388006 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:48.388007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:48.388018 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:48.388078 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:48.388444 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:48.388980 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:48.389687 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:48.389893 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:48.389983 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:48.392869 (+ 2886us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.193:44877: BlockingRecv error: recv got EOF from 127.12.202.193:44877 (error 108)
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":134,"threads_started":1}
Aug 09 18:47:48 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:48 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:48.542418 28281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:48.531703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:39697)
0809 18:47:48.531883 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:48.531893 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:48.531949 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:48.532064 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:48.532065 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:48.532251 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:48.532331 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:48.532333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:48.532994 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:48.532995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:48.533612 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:48.533615 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:48.534015 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:48.534016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:48.534061 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:48.540177 (+ 6116us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:48.540182 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:48.542315 (+ 2133us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":116,"threads_started":1}
W20260809 18:47:48.542475 28280 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:48.531760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:39697 (local address 127.12.202.254:43279)
0809 18:47:48.531822 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:48.531825 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:48.531949 (+ 124us) server_negotiation.cc:407] Connection header received
0809 18:47:48.532006 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:48.532006 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:48.532018 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:48.532059 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:48.532395 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:48.532902 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:48.533695 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:48.533931 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:48.533993 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:48.542411 (+ 8418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.194:39697: BlockingRecv error: recv got EOF from 127.12.202.194:39697 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 09 18:47:48 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:48 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.195@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:48.660923 28282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:48.655884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.195:37201)
0809 18:47:48.656027 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:48.656040 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:48.656095 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:48.656244 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:48.656245 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:48.656438 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:48.656486 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:48.656488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:48.657087 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:48.657087 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:48.657931 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:48.657936 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:48.658438 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:48.658439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:48.658492 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:48.658932 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:48.658936 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:48.660842 (+ 1906us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":87,"threads_started":1}
W20260809 18:47:48.661172 28280 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:48.655969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:37201 (local address 127.12.202.254:43279)
0809 18:47:48.656080 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:48.656081 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:48.656092 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:47:48.656154 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:48.656154 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:48.656167 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:48.656226 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:48.656551 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:48.657022 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:48.658025 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:48.658340 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:48.658419 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:48.660953 (+ 2534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.195:37201: BlockingRecv error: recv got EOF from 127.12.202.195:37201 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 09 18:47:49 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:49 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.193@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:49.397922 28283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:49.393379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.193:56465)
0809 18:47:49.393551 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:49.393564 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:49.393623 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:49.393797 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:49.393798 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:49.394025 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:49.394096 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:49.394099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:49.394708 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:49.394708 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:49.395259 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:49.395260 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:49.395613 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:49.395614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:49.395665 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:49.396114 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:49.396118 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:49.397866 (+ 1748us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":89,"threads_started":1}
W20260809 18:47:49.398046 28287 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:49.393437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:56465 (local address 127.12.202.254:43279)
0809 18:47:49.393624 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:49.393626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:49.393637 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:47:49.393670 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:49.393670 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:49.393683 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:49.393756 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:49.394185 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:49.394645 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:49.395343 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:49.395529 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:49.395577 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:49.397952 (+ 2375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.193:56465: BlockingRecv error: recv got EOF from 127.12.202.193:56465 (error 108)
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":85,"threads_started":1}
Aug 09 18:47:49 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
Aug 09 18:47:49 dist-test-slave-45dx krb5kdc[26575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.202.194@KRBTEST.COM for oryx/127.12.202.254@KRBTEST.COM, Server not found in Kerberos database
I20260809 18:47:49.548110 28288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:49.542979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43279 (local address 127.12.202.194:32885)
0809 18:47:49.543219 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:49.543232 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:49.543289 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:49.543409 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:49.543410 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:49.543577 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:49.543625 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:49.543626 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:49.544569 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:49.544570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:49.545190 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:49.545192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:49.545579 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:49.545580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:49.545621 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:49.546191 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:49.546195 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:49.548042 (+ 1847us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.202.254:43279: Server oryx/127.12.202.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":180,"threads_started":1}
W20260809 18:47:49.548237 28287 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:49.543067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:32885 (local address 127.12.202.254:43279)
0809 18:47:49.543143 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:49.543145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:49.543290 (+ 145us) server_negotiation.cc:407] Connection header received
0809 18:47:49.543338 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:49.543338 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:49.543350 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:49.543403 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:49.543683 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:49.544500 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:49.545283 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:49.545505 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:49.545575 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:49.548135 (+ 2560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.202.194:32885: BlockingRecv error: recv got EOF from 127.12.202.194:32885 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 18:47:49.586639 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 27514
I20260809 18:47:49.599365 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 27769
I20260809 18:47:49.608805 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 27977
I20260809 18:47:49.616966 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 27399
2026-08-09T18:47:49Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17755 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T18:47:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:47:49Z Disabled control of system clock
I20260809 18:47:49.653519 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:39735
--webserver_interface=127.12.202.254
--webserver_port=0
--builtin_ntp_servers=127.12.202.212:41013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:39735
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 18:47:49.734735 28295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:49.734936 28295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:49.734956 28295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:49.736011 28295 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:47:49.736044 28295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:49.736056 28295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:49.736068 28295 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:47:49.736080 28295 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:47:49.737320 28295 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:41013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:39735
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:39735
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:49.737504 28295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:49.737722 28295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:49.742533 28314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:49.742551 28307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:49.742700 28295 server_base.cc:1034] running on GCE node
W20260809 18:47:49.742555 28306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:49.743021 28295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:49.743314 28295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:49.744478 28295 hybrid_clock.cc:648] HybridClock initialized: now 1786301269744474 us; error 37 us; skew 500 ppm
I20260809 18:47:49.745605 28295 webserver.cc:460] Webserver started at http://127.12.202.254:37519/ using document root <none> and password file <none>
I20260809 18:47:49.745865 28295 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:49.745910 28295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:49.745997 28295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:49.746953 28295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "f8de189e06cb4279b3827fa4962f8637"
format_stamp: "Formatted at 2026-08-09 18:47:49 on dist-test-slave-45dx"
server_key: "233e657195cf218c22a7cfe228f69b2a"
server_key_iv: "5763a754ea4290f728d5188bdd003abb"
server_key_version: "encryptionkey@0"
I20260809 18:47:49.747239 28295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "f8de189e06cb4279b3827fa4962f8637"
format_stamp: "Formatted at 2026-08-09 18:47:49 on dist-test-slave-45dx"
server_key: "233e657195cf218c22a7cfe228f69b2a"
server_key_iv: "5763a754ea4290f728d5188bdd003abb"
server_key_version: "encryptionkey@0"
I20260809 18:47:49.748559 28295 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:47:49.749217 28322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:49.749374 28295 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:47:49.749475 28295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "f8de189e06cb4279b3827fa4962f8637"
format_stamp: "Formatted at 2026-08-09 18:47:49 on dist-test-slave-45dx"
server_key: "233e657195cf218c22a7cfe228f69b2a"
server_key_iv: "5763a754ea4290f728d5188bdd003abb"
server_key_version: "encryptionkey@0"
I20260809 18:47:49.749558 28295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:49.767743 28295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:49.768018 28295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:49.768164 28295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:49.772181 28295 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:39735
I20260809 18:47:49.772212 28405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:39735 every 8 connection(s)
I20260809 18:47:49.772598 28295 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:47:49.773277 28406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:49.775731 28406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637: Bootstrap starting.
I20260809 18:47:49.776261 28406 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:49.776599 28406 log.cc:824] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637: Log is configured to *not* fsync() on all Append() calls
I20260809 18:47:49.777185 28406 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637: No bootstrap required, opened a new log
I20260809 18:47:49.777892 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 28295
I20260809 18:47:49.778017 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:47:49.778195 13099 external_mini_cluster.cc:1428] Setting key 09144f5bbfe50ba6088de5c802dcb100
I20260809 18:47:49.779058 28406 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8de189e06cb4279b3827fa4962f8637" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39735 } }
I20260809 18:47:49.779224 28406 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:49.779265 28406 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8de189e06cb4279b3827fa4962f8637, State: Initialized, Role: FOLLOWER
I20260809 18:47:49.779426 28406 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8de189e06cb4279b3827fa4962f8637" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39735 } }
I20260809 18:47:49.779520 28406 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:47:49.779543 28406 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:47:49.779605 28406 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:49.780122 28406 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8de189e06cb4279b3827fa4962f8637" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39735 } }
I20260809 18:47:49.780207 28406 leader_election.cc:302] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8de189e06cb4279b3827fa4962f8637; no voters:
I20260809 18:47:49.780405 28406 leader_election.cc:288] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:47:49.780435 28413 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:47:49.780539 28413 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637 [term 1 LEADER]: Becoming Leader. State: Replica: f8de189e06cb4279b3827fa4962f8637, State: Running, Role: LEADER
I20260809 18:47:49.780617 28413 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8de189e06cb4279b3827fa4962f8637" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39735 } }
I20260809 18:47:49.780654 28406 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:47:49.780925 28413 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8de189e06cb4279b3827fa4962f8637" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8de189e06cb4279b3827fa4962f8637" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39735 } } }
I20260809 18:47:49.781104 28413 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637 [sys.catalog]: This master's current role is: LEADER
I20260809 18:47:49.781299 28413 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8de189e06cb4279b3827fa4962f8637. Latest consensus state: current_term: 1 leader_uuid: "f8de189e06cb4279b3827fa4962f8637" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8de189e06cb4279b3827fa4962f8637" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39735 } } }
I20260809 18:47:49.781381 28413 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637 [sys.catalog]: This master's current role is: LEADER
I20260809 18:47:49.781770 28427 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:47:49.782305 28427 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:47:49.783841 28427 catalog_manager.cc:1347] Generated new cluster ID: 80e0ad976cdd4d26a5881365c08d7983
I20260809 18:47:49.783897 28427 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:47:49.784540 28412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:49.778717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34282 (local address 127.12.202.254:39735)
0809 18:47:49.778920 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:49.778927 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:49.778950 (+ 23us) server_negotiation.cc:407] Connection header received
0809 18:47:49.779038 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:49.779044 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:49.779112 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:49.779216 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:49.779459 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:49.781004 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:49.782134 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:49.782822 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:49.782969 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:49.783692 (+ 723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:49.783696 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:49.783696 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:47:49.783954 (+ 258us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:49.783996 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:47:49.784010 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:49.784097 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:49.784184 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 18:47:49.784372 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":89,"threads_started":1}
I20260809 18:47:49.798538 28427 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:47:49.799209 28427 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:47:49.805925 28427 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8de189e06cb4279b3827fa4962f8637: Generated new TSK 0
I20260809 18:47:49.806085 28427 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:47:49.809247 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39735
--builtin_ntp_servers=127.12.202.212:41013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 18:47:49.889977 28441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:49.890208 28441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:49.890244 28441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:49.891400 28441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:49.891460 28441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:49.891501 28441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:47:49.892930 28441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:41013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:49.893193 28441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:49.893486 28441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:49.898564 28454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:49.898614 28452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:49.898564 28450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:49.898909 28441 server_base.cc:1034] running on GCE node
I20260809 18:47:49.899109 28441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:49.899425 28441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:49.900575 28441 hybrid_clock.cc:648] HybridClock initialized: now 1786301269900562 us; error 28 us; skew 500 ppm
I20260809 18:47:49.901870 28441 webserver.cc:460] Webserver started at http://127.12.202.193:35779/ using document root <none> and password file <none>
I20260809 18:47:49.902127 28441 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:49.902200 28441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:49.902359 28441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:49.903411 28441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "402ad9be727840c2adb1cd62f50c6317"
format_stamp: "Formatted at 2026-08-09 18:47:49 on dist-test-slave-45dx"
server_key: "dc2d9483fa2f7550cb530bb16dd96d6b"
server_key_iv: "ac8dada6f2e1a466760d1e4861245e02"
server_key_version: "encryptionkey@0"
I20260809 18:47:49.903777 28441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "402ad9be727840c2adb1cd62f50c6317"
format_stamp: "Formatted at 2026-08-09 18:47:49 on dist-test-slave-45dx"
server_key: "dc2d9483fa2f7550cb530bb16dd96d6b"
server_key_iv: "ac8dada6f2e1a466760d1e4861245e02"
server_key_version: "encryptionkey@0"
I20260809 18:47:49.905186 28441 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:47:49.906046 28462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:49.906240 28441 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:47:49.906358 28441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "402ad9be727840c2adb1cd62f50c6317"
format_stamp: "Formatted at 2026-08-09 18:47:49 on dist-test-slave-45dx"
server_key: "dc2d9483fa2f7550cb530bb16dd96d6b"
server_key_iv: "ac8dada6f2e1a466760d1e4861245e02"
server_key_version: "encryptionkey@0"
I20260809 18:47:49.906440 28441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:49.912911 28441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:49.913218 28441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:49.913371 28441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:49.913575 28441 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:47:49.913901 28441 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:47:49.913965 28441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:49.914007 28441 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:47:49.914034 28441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:49.919705 28441 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:37061
I20260809 18:47:49.919826 28649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:37061 every 8 connection(s)
I20260809 18:47:49.920125 28441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:47:49.924782 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 28441
I20260809 18:47:49.924880 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:47:49.925143 13099 external_mini_cluster.cc:1428] Setting key f607bea9d0055f7ae179219b47f34741
I20260809 18:47:49.925522 28412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:49.920863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:42699 (local address 127.12.202.254:39735)
0809 18:47:49.920937 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:49.920939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:49.921185 (+ 246us) server_negotiation.cc:407] Connection header received
0809 18:47:49.921726 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:49.921727 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:49.921754 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:49.921812 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:49.922480 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:49.922974 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:49.923941 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:49.924166 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:49.924241 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:49.925167 (+ 926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:49.925168 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:49.925169 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:47:49.925174 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:49.925194 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:47:49.925198 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:49.925260 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:49.925407 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 18:47:49.925439 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 18:47:49.925719 28653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:49.920871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:39735 (local address 127.12.202.193:42699)
0809 18:47:49.921060 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:49.921092 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:49.921611 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:49.921886 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:49.921890 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:49.921898 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:49.922369 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:49.922373 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:49.923069 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:49.923070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:49.923843 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:49.923845 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:49.924251 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:49.924252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:49.924395 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:49.925036 (+ 641us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:47:49.925037 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:49.925063 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:47:49.925085 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:49.925290 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:49.925298 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:49.925301 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:47:49.925373 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 18:47:49.925493 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":88,"threads_started":1}
I20260809 18:47:49.926162 28650 heartbeater.cc:347] Connected to a master server at 127.12.202.254:39735
I20260809 18:47:49.926193 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39735
--builtin_ntp_servers=127.12.202.212:41013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 18:47:49.926240 28650 heartbeater.cc:464] Registering TS with master...
I20260809 18:47:49.926448 28650 heartbeater.cc:511] Master 127.12.202.254:39735 requested a full tablet report, sending...
I20260809 18:47:49.926978 28347 ts_manager.cc:194] Registered new tserver with Master: 402ad9be727840c2adb1cd62f50c6317 (127.12.202.193:37061)
I20260809 18:47:49.927863 28347 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.202.193:42699
W20260809 18:47:50.008649 28654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:50.008926 28654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:50.008955 28654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:50.010223 28654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:50.010262 28654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:50.010288 28654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:47:50.011754 28654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:41013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:50.011996 28654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:50.012322 28654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:50.017433 28666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:50.017508 28654 server_base.cc:1034] running on GCE node
W20260809 18:47:50.017452 28661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:50.017493 28669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:50.018007 28654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:50.018256 28654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:50.019420 28654 hybrid_clock.cc:648] HybridClock initialized: now 1786301270019418 us; error 35 us; skew 500 ppm
I20260809 18:47:50.020761 28654 webserver.cc:460] Webserver started at http://127.12.202.194:34507/ using document root <none> and password file <none>
I20260809 18:47:50.021025 28654 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:50.021109 28654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:50.021261 28654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:50.022328 28654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "fcecefe3568a4ae9bf0f00fd4b4c2d7a"
format_stamp: "Formatted at 2026-08-09 18:47:50 on dist-test-slave-45dx"
server_key: "3fd73794043f4ddc3c1cbc01b84ad123"
server_key_iv: "72cd012b43dd834347b2b2c8009f9a21"
server_key_version: "encryptionkey@0"
I20260809 18:47:50.022696 28654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "fcecefe3568a4ae9bf0f00fd4b4c2d7a"
format_stamp: "Formatted at 2026-08-09 18:47:50 on dist-test-slave-45dx"
server_key: "3fd73794043f4ddc3c1cbc01b84ad123"
server_key_iv: "72cd012b43dd834347b2b2c8009f9a21"
server_key_version: "encryptionkey@0"
I20260809 18:47:50.024019 28654 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:47:50.024883 28677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:50.025086 28654 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:47:50.025193 28654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "fcecefe3568a4ae9bf0f00fd4b4c2d7a"
format_stamp: "Formatted at 2026-08-09 18:47:50 on dist-test-slave-45dx"
server_key: "3fd73794043f4ddc3c1cbc01b84ad123"
server_key_iv: "72cd012b43dd834347b2b2c8009f9a21"
server_key_version: "encryptionkey@0"
I20260809 18:47:50.025280 28654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:50.038595 28654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:50.038915 28654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:50.039072 28654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:50.039291 28654 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:47:50.039639 28654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:47:50.039703 28654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:50.039746 28654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:47:50.039775 28654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:50.045936 28654 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:38933
I20260809 18:47:50.045986 28873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:38933 every 8 connection(s)
I20260809 18:47:50.046307 28654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:47:50.051733 28412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:50.047066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:43239 (local address 127.12.202.254:39735)
0809 18:47:50.047148 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:50.047150 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:50.047413 (+ 263us) server_negotiation.cc:407] Connection header received
0809 18:47:50.047966 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:50.047968 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:50.047981 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:50.048035 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:50.048797 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:50.049309 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:50.050290 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:50.050496 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:50.050576 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:50.051427 (+ 851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:50.051428 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:50.051429 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:47:50.051434 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:50.051450 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:47:50.051454 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:50.051522 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:50.051618 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 18:47:50.051651 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 18:47:50.051982 28878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:50.047040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:39735 (local address 127.12.202.194:43239)
0809 18:47:50.047264 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:50.047297 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:50.047844 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:50.048108 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:50.048112 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:50.048119 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:50.048703 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:50.048708 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:50.049411 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:50.049412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:50.050184 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:50.050186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:50.050586 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:50.050587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:50.050736 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:50.051272 (+ 536us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:47:50.051272 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:50.051301 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:47:50.051322 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:50.051524 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:50.051530 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:50.051534 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:47:50.051620 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 18:47:50.051724 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":102,"threads_started":1}
I20260809 18:47:50.052139 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 28654
I20260809 18:47:50.052232 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:47:50.052515 13099 external_mini_cluster.cc:1428] Setting key 15fd1dbe2e1567f61636962b9260fb09
I20260809 18:47:50.052541 28875 heartbeater.cc:347] Connected to a master server at 127.12.202.254:39735
I20260809 18:47:50.052634 28875 heartbeater.cc:464] Registering TS with master...
I20260809 18:47:50.052850 28875 heartbeater.cc:511] Master 127.12.202.254:39735 requested a full tablet report, sending...
I20260809 18:47:50.053292 28347 ts_manager.cc:194] Registered new tserver with Master: fcecefe3568a4ae9bf0f00fd4b4c2d7a (127.12.202.194:38933)
I20260809 18:47:50.053637 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39735
--builtin_ntp_servers=127.12.202.212:41013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 18:47:50.053669 28347 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.202.194:43239
W20260809 18:47:50.136006 28882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:50.136225 28882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:50.136246 28882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:50.137342 28882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:50.137375 28882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:50.137399 28882 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:47:50.138702 28882 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:41013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:50.138921 28882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:50.139161 28882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:50.144344 28894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:50.144348 28896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:50.144416 28882 server_base.cc:1034] running on GCE node
W20260809 18:47:50.144353 28893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:50.144795 28882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:50.145046 28882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:50.146186 28882 hybrid_clock.cc:648] HybridClock initialized: now 1786301270146177 us; error 26 us; skew 500 ppm
I20260809 18:47:50.147370 28882 webserver.cc:460] Webserver started at http://127.12.202.195:33289/ using document root <none> and password file <none>
I20260809 18:47:50.147573 28882 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:50.147612 28882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:50.147703 28882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:50.148782 28882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "35a30c6693c54456b89de2c18a4c404d"
format_stamp: "Formatted at 2026-08-09 18:47:50 on dist-test-slave-45dx"
server_key: "c77635ae728867c1b836295deea7071a"
server_key_iv: "839700fa0a9607176888cf5be53fd9ab"
server_key_version: "encryptionkey@0"
I20260809 18:47:50.149083 28882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "35a30c6693c54456b89de2c18a4c404d"
format_stamp: "Formatted at 2026-08-09 18:47:50 on dist-test-slave-45dx"
server_key: "c77635ae728867c1b836295deea7071a"
server_key_iv: "839700fa0a9607176888cf5be53fd9ab"
server_key_version: "encryptionkey@0"
I20260809 18:47:50.150266 28882 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:47:50.150933 28906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:50.151114 28882 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:47:50.151198 28882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "35a30c6693c54456b89de2c18a4c404d"
format_stamp: "Formatted at 2026-08-09 18:47:50 on dist-test-slave-45dx"
server_key: "c77635ae728867c1b836295deea7071a"
server_key_iv: "839700fa0a9607176888cf5be53fd9ab"
server_key_version: "encryptionkey@0"
I20260809 18:47:50.151270 28882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:50.172722 28882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:50.173043 28882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:50.173194 28882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:50.173421 28882 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:47:50.173750 28882 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:47:50.173784 28882 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:50.173806 28882 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:47:50.173858 28882 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:50.179616 28882 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:37727
I20260809 18:47:50.179694 29102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:37727 every 8 connection(s)
I20260809 18:47:50.180127 28882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:47:50.185707 28412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:50.180920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:35477 (local address 127.12.202.254:39735)
0809 18:47:50.180984 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:50.180986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:50.181341 (+ 355us) server_negotiation.cc:407] Connection header received
0809 18:47:50.181960 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:50.181962 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:50.181975 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:50.182031 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:50.182728 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:50.183238 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:50.184243 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:50.184472 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:50.184551 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:50.185391 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:50.185392 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:50.185392 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:47:50.185397 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:50.185413 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:47:50.185417 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:50.185489 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:50.185595 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 18:47:50.185627 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 18:47:50.185936 29106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:50.180923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:39735 (local address 127.12.202.195:35477)
0809 18:47:50.181198 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:50.181253 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:50.181855 (+ 602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:50.182097 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:50.182101 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:50.182111 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:50.182615 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:50.182619 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:50.183343 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:50.183344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:50.184108 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:50.184123 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:50.184563 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:50.184564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:50.184698 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:50.185229 (+ 531us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:47:50.185230 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:50.185258 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:47:50.185278 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:50.185489 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:50.185496 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:50.185500 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:47:50.185596 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 18:47:50.185693 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":131,"threads_started":1}
I20260809 18:47:50.186476 29104 heartbeater.cc:347] Connected to a master server at 127.12.202.254:39735
I20260809 18:47:50.186578 29104 heartbeater.cc:464] Registering TS with master...
I20260809 18:47:50.186769 29104 heartbeater.cc:511] Master 127.12.202.254:39735 requested a full tablet report, sending...
I20260809 18:47:50.187189 28347 ts_manager.cc:194] Registered new tserver with Master: 35a30c6693c54456b89de2c18a4c404d (127.12.202.195:37727)
I20260809 18:47:50.187590 28347 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.202.195:35477
I20260809 18:47:50.189483 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 28882
I20260809 18:47:50.189563 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:47:50.189778 13099 external_mini_cluster.cc:1428] Setting key ed5c1f8458a24deb921c0377c48d2d30
I20260809 18:47:50.190672 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 18:47:50.192792 28412 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:50.192033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34284 (local address 127.12.202.254:39735)
0809 18:47:50.192080 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:50.192082 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:50.192191 (+ 109us) server_negotiation.cc:407] Connection header received
0809 18:47:50.192242 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:50.192243 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:50.192252 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:50.192320 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:50.192734 (+ 414us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34284: BlockingRecv error: recv got EOF from 127.0.0.1:34284 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:47:50.192852 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 28441
I20260809 18:47:50.211266 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 28654
I20260809 18:47:50.222631 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 28882
I20260809 18:47:50.230307 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 28295
2026-08-09T18:47:50Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (609 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T18:47:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:47:50Z Disabled control of system clock
I20260809 18:47:50.262789 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:35985
--webserver_interface=127.12.202.254
--webserver_port=0
--builtin_ntp_servers=127.12.202.212:33635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:35985
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 18:47:50.344729 29128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:50.344920 29128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:50.344940 29128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:50.346045 29128 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:47:50.346084 29128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:50.346096 29128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:50.346109 29128 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:47:50.346159 29128 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:47:50.347533 29128 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:33635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:35985
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:35985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29128
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:50.347781 29128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:50.348079 29128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:50.352654 29141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:50.352658 29136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:50.352680 29128 server_base.cc:1034] running on GCE node
W20260809 18:47:50.352680 29137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:50.353097 29128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:50.353379 29128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:50.354526 29128 hybrid_clock.cc:648] HybridClock initialized: now 1786301270354505 us; error 39 us; skew 500 ppm
I20260809 18:47:50.360786 29128 webserver.cc:460] Webserver started at http://127.12.202.254:40661/ using document root <none> and password file <none>
I20260809 18:47:50.361042 29128 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:50.361088 29128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:50.361253 29128 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:50.362305 29128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "c760d1dc8f9f467d94cb98baedbc74d2"
format_stamp: "Formatted at 2026-08-09 18:47:50 on dist-test-slave-45dx"
server_key: "00e1cde5bc55d6d0041d0bc1eecfa672"
server_key_iv: "5be3f53d65eed19727dcb290cdac26c5"
server_key_version: "encryptionkey@0"
I20260809 18:47:50.362666 29128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "c760d1dc8f9f467d94cb98baedbc74d2"
format_stamp: "Formatted at 2026-08-09 18:47:50 on dist-test-slave-45dx"
server_key: "00e1cde5bc55d6d0041d0bc1eecfa672"
server_key_iv: "5be3f53d65eed19727dcb290cdac26c5"
server_key_version: "encryptionkey@0"
I20260809 18:47:50.363931 29128 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 18:47:50.364703 29150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:50.364885 29128 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:50.364964 29128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "c760d1dc8f9f467d94cb98baedbc74d2"
format_stamp: "Formatted at 2026-08-09 18:47:50 on dist-test-slave-45dx"
server_key: "00e1cde5bc55d6d0041d0bc1eecfa672"
server_key_iv: "5be3f53d65eed19727dcb290cdac26c5"
server_key_version: "encryptionkey@0"
I20260809 18:47:50.365048 29128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:50.368181 29128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:50.368474 29128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:50.368609 29128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:50.372637 29128 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:35985
I20260809 18:47:50.372686 29234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:35985 every 8 connection(s)
I20260809 18:47:50.373005 29128 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:47:50.373633 29238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:50.376223 29238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2: Bootstrap starting.
I20260809 18:47:50.376817 29238 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:50.377084 29238 log.cc:824] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2: Log is configured to *not* fsync() on all Append() calls
I20260809 18:47:50.377203 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 29128
I20260809 18:47:50.377303 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:47:50.377511 13099 external_mini_cluster.cc:1428] Setting key 2acbe7cf967ffcfa2e3721ebc4e58c58
I20260809 18:47:50.377874 29238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2: No bootstrap required, opened a new log
I20260809 18:47:50.380199 29238 raft_consensus.cc:348] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c760d1dc8f9f467d94cb98baedbc74d2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 35985 } }
I20260809 18:47:50.380445 29238 raft_consensus.cc:374] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:50.380489 29238 raft_consensus.cc:729] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c760d1dc8f9f467d94cb98baedbc74d2, State: Initialized, Role: FOLLOWER
I20260809 18:47:50.380663 29242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:50.378030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55544 (local address 127.12.202.254:35985)
0809 18:47:50.378205 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:50.378213 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:50.378244 (+ 31us) server_negotiation.cc:407] Connection header received
0809 18:47:50.379255 (+ 1011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:50.379263 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:50.379312 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:50.379463 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:50.380101 (+ 638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:50.380105 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:50.380105 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:47:50.380110 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:50.380176 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:47:50.380190 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:50.380269 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:50.380425 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 18:47:50.380482 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":68,"threads_started":1}
I20260809 18:47:50.380626 29238 consensus_queue.cc:260] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c760d1dc8f9f467d94cb98baedbc74d2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 35985 } }
I20260809 18:47:50.380733 29238 raft_consensus.cc:388] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:47:50.380766 29238 raft_consensus.cc:482] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:47:50.380805 29238 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:50.381686 29238 raft_consensus.cc:504] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c760d1dc8f9f467d94cb98baedbc74d2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 35985 } }
I20260809 18:47:50.381804 29238 leader_election.cc:302] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c760d1dc8f9f467d94cb98baedbc74d2; no voters:
I20260809 18:47:50.382015 29238 leader_election.cc:288] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:47:50.382066 29243 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:47:50.382242 29243 raft_consensus.cc:686] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2 [term 1 LEADER]: Becoming Leader. State: Replica: c760d1dc8f9f467d94cb98baedbc74d2, State: Running, Role: LEADER
I20260809 18:47:50.382282 29238 sys_catalog.cc:564] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:47:50.382332 29243 consensus_queue.cc:237] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c760d1dc8f9f467d94cb98baedbc74d2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 35985 } }
I20260809 18:47:50.382669 29247 sys_catalog.cc:455] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c760d1dc8f9f467d94cb98baedbc74d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c760d1dc8f9f467d94cb98baedbc74d2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 35985 } } }
I20260809 18:47:50.382680 29248 sys_catalog.cc:455] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c760d1dc8f9f467d94cb98baedbc74d2. Latest consensus state: current_term: 1 leader_uuid: "c760d1dc8f9f467d94cb98baedbc74d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c760d1dc8f9f467d94cb98baedbc74d2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 35985 } } }
I20260809 18:47:50.382892 29248 sys_catalog.cc:458] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2 [sys.catalog]: This master's current role is: LEADER
I20260809 18:47:50.383086 29247 sys_catalog.cc:458] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2 [sys.catalog]: This master's current role is: LEADER
I20260809 18:47:50.383352 29257 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:47:50.383862 29257 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:47:50.385435 29257 catalog_manager.cc:1347] Generated new cluster ID: 66cc306c12514958ad77202dfec2d3e9
I20260809 18:47:50.385489 29257 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:47:50.393993 29257 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:47:50.394148 29257 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:47:50.404520 29257 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c760d1dc8f9f467d94cb98baedbc74d2: Generated new TSK 0
I20260809 18:47:50.404695 29257 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:47:50.408782 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:35985
--builtin_ntp_servers=127.12.202.212:33635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 18:47:50.526109 29277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:50.526422 29277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:50.526481 29277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:50.528200 29277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:50.528257 29277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:50.528292 29277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:47:50.530153 29277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:33635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:35985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:50.530385 29277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:50.530728 29277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:50.536242 29287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:50.536232 29292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:50.536486 29277 server_base.cc:1034] running on GCE node
W20260809 18:47:50.536681 29290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:50.536943 29277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:50.537230 29277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:50.538429 29277 hybrid_clock.cc:648] HybridClock initialized: now 1786301270538405 us; error 35 us; skew 500 ppm
I20260809 18:47:50.539952 29277 webserver.cc:460] Webserver started at http://127.12.202.193:33501/ using document root <none> and password file <none>
I20260809 18:47:50.540220 29277 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:50.540293 29277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:50.540482 29277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:50.541963 29277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "7b776c9219774ef79c3942d11833ba4b"
format_stamp: "Formatted at 2026-08-09 18:47:50 on dist-test-slave-45dx"
server_key: "76a73fa3e2794162ff38cfda60acff53"
server_key_iv: "f763cebf40ff02f7d9747a98624e442d"
server_key_version: "encryptionkey@0"
I20260809 18:47:50.542416 29277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "7b776c9219774ef79c3942d11833ba4b"
format_stamp: "Formatted at 2026-08-09 18:47:50 on dist-test-slave-45dx"
server_key: "76a73fa3e2794162ff38cfda60acff53"
server_key_iv: "f763cebf40ff02f7d9747a98624e442d"
server_key_version: "encryptionkey@0"
I20260809 18:47:50.544242 29277 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260809 18:47:50.545186 29304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:50.545423 29277 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:47:50.545526 29277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "7b776c9219774ef79c3942d11833ba4b"
format_stamp: "Formatted at 2026-08-09 18:47:50 on dist-test-slave-45dx"
server_key: "76a73fa3e2794162ff38cfda60acff53"
server_key_iv: "f763cebf40ff02f7d9747a98624e442d"
server_key_version: "encryptionkey@0"
I20260809 18:47:50.545604 29277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:50.550144 29277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:50.550429 29277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:50.550557 29277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:50.550760 29277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:47:50.551082 29277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:47:50.551122 29277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:50.551147 29277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:47:50.551164 29277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:50.558141 29277 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:41385
I20260809 18:47:50.558172 29491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:41385 every 8 connection(s)
I20260809 18:47:50.558542 29277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:47:50.561723 29242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:50.559313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:37537 (local address 127.12.202.254:35985)
0809 18:47:50.559368 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:50.559369 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:50.559593 (+ 224us) server_negotiation.cc:407] Connection header received
0809 18:47:50.560082 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:50.560084 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:50.560090 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:50.560147 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:50.561469 (+ 1322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:50.561471 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:50.561471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:47:50.561476 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:50.561492 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:47:50.561496 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:50.561553 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:50.561641 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 18:47:50.561655 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 18:47:50.561954 29494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:50.559303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:35985 (local address 127.12.202.193:37537)
0809 18:47:50.559473 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:50.559505 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:50.559981 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:50.560216 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:50.560219 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:50.560227 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:50.561318 (+ 1091us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:47:50.561319 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:50.561351 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:47:50.561378 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:50.561553 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:50.561559 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:50.561562 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:47:50.561651 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 18:47:50.561709 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":96,"threads_started":1}
I20260809 18:47:50.562414 29492 heartbeater.cc:347] Connected to a master server at 127.12.202.254:35985
I20260809 18:47:50.562523 29492 heartbeater.cc:464] Registering TS with master...
I20260809 18:47:50.562674 29492 heartbeater.cc:511] Master 127.12.202.254:35985 requested a full tablet report, sending...
I20260809 18:47:50.563133 29176 ts_manager.cc:194] Registered new tserver with Master: 7b776c9219774ef79c3942d11833ba4b (127.12.202.193:41385)
I20260809 18:47:50.565744 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 29277
I20260809 18:47:50.565817 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:47:50.566021 13099 external_mini_cluster.cc:1428] Setting key 5c8d1589c8536b48d512e5f04a86d579
I20260809 18:47:50.566908 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:35985
--builtin_ntp_servers=127.12.202.212:33635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 18:47:50.648154 29495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:50.648451 29495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:50.648494 29495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:50.649744 29495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:50.649803 29495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:50.649847 29495 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:47:50.651328 29495 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:33635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:35985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:50.651599 29495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:50.651954 29495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:50.657276 29502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:50.657275 29509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:50.657536 29495 server_base.cc:1034] running on GCE node
W20260809 18:47:50.657773 29503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:50.658038 29495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:50.658346 29495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:50.659509 29495 hybrid_clock.cc:648] HybridClock initialized: now 1786301270659487 us; error 41 us; skew 500 ppm
I20260809 18:47:50.661253 29495 webserver.cc:460] Webserver started at http://127.12.202.194:41499/ using document root <none> and password file <none>
I20260809 18:47:50.661537 29495 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:50.661599 29495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:50.661727 29495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:50.663188 29495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "3a2ac4a1d64c47f2904dd9e6f4d640c4"
format_stamp: "Formatted at 2026-08-09 18:47:50 on dist-test-slave-45dx"
server_key: "3a56ce73dbd49bd6025430edf1b3bda4"
server_key_iv: "62d3e8c70835f27e1fff6f97ff454906"
server_key_version: "encryptionkey@0"
I20260809 18:47:50.663681 29495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "3a2ac4a1d64c47f2904dd9e6f4d640c4"
format_stamp: "Formatted at 2026-08-09 18:47:50 on dist-test-slave-45dx"
server_key: "3a56ce73dbd49bd6025430edf1b3bda4"
server_key_iv: "62d3e8c70835f27e1fff6f97ff454906"
server_key_version: "encryptionkey@0"
I20260809 18:47:50.666549 29495 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260809 18:47:50.667590 29517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:50.667840 29495 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:47:50.667943 29495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "3a2ac4a1d64c47f2904dd9e6f4d640c4"
format_stamp: "Formatted at 2026-08-09 18:47:50 on dist-test-slave-45dx"
server_key: "3a56ce73dbd49bd6025430edf1b3bda4"
server_key_iv: "62d3e8c70835f27e1fff6f97ff454906"
server_key_version: "encryptionkey@0"
I20260809 18:47:50.668031 29495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:50.671412 29495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:50.671629 29495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:50.671728 29495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:50.671877 29495 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:47:50.672181 29495 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:47:50.672214 29495 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:50.672233 29495 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:47:50.672245 29495 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:50.677994 29495 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:44455
I20260809 18:47:50.678041 29698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:44455 every 8 connection(s)
I20260809 18:47:50.678324 29495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:47:50.681083 29242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:50.679006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:39549 (local address 127.12.202.254:35985)
0809 18:47:50.679087 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:50.679089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:50.679274 (+ 185us) server_negotiation.cc:407] Connection header received
0809 18:47:50.679685 (+ 411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:50.679686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:50.679690 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:50.679743 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:50.680887 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:50.680888 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:50.680888 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:47:50.680891 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:50.680903 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:47:50.680907 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:50.680947 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:50.681018 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 18:47:50.681030 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 18:47:50.681288 29702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:50.678969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:35985 (local address 127.12.202.194:39549)
0809 18:47:50.679167 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:50.679197 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:50.679604 (+ 407us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:50.679791 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:50.679793 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:50.679801 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:50.680763 (+ 962us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:47:50.680764 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:50.680789 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:47:50.680816 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:50.680948 (+ 132us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:50.680950 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:50.680952 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:47:50.681018 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 18:47:50.681061 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":97,"threads_started":1}
I20260809 18:47:50.681800 29699 heartbeater.cc:347] Connected to a master server at 127.12.202.254:35985
I20260809 18:47:50.681902 29699 heartbeater.cc:464] Registering TS with master...
I20260809 18:47:50.682053 29699 heartbeater.cc:511] Master 127.12.202.254:35985 requested a full tablet report, sending...
I20260809 18:47:50.682193 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 29495
I20260809 18:47:50.682363 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:47:50.682475 29176 ts_manager.cc:194] Registered new tserver with Master: 3a2ac4a1d64c47f2904dd9e6f4d640c4 (127.12.202.194:44455)
I20260809 18:47:50.682607 13099 external_mini_cluster.cc:1428] Setting key 107ce459f1feb1fc287e1ac7db99978e
I20260809 18:47:50.683569 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:35985
--builtin_ntp_servers=127.12.202.212:33635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 18:47:50.767607 29704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:50.767838 29704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:50.767880 29704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:50.769234 29704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:50.769297 29704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:50.769338 29704 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:47:50.770759 29704 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:33635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:35985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:50.771034 29704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:50.771332 29704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:47:50.776563 29704 server_base.cc:1034] running on GCE node
W20260809 18:47:50.776571 29714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:50.776680 29718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:50.776573 29715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:50.777114 29704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:50.777313 29704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:50.778461 29704 hybrid_clock.cc:648] HybridClock initialized: now 1786301270778449 us; error 28 us; skew 500 ppm
I20260809 18:47:50.779718 29704 webserver.cc:460] Webserver started at http://127.12.202.195:45007/ using document root <none> and password file <none>
I20260809 18:47:50.779930 29704 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:50.779971 29704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:50.780058 29704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:50.781128 29704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "e11f58dcf789429a89398363f21d4ed7"
format_stamp: "Formatted at 2026-08-09 18:47:50 on dist-test-slave-45dx"
server_key: "e62a84b7b9e902a72271c0330249820b"
server_key_iv: "66493d02dcb32185bc215ff332bd51e8"
server_key_version: "encryptionkey@0"
I20260809 18:47:50.781440 29704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "e11f58dcf789429a89398363f21d4ed7"
format_stamp: "Formatted at 2026-08-09 18:47:50 on dist-test-slave-45dx"
server_key: "e62a84b7b9e902a72271c0330249820b"
server_key_iv: "66493d02dcb32185bc215ff332bd51e8"
server_key_version: "encryptionkey@0"
I20260809 18:47:50.782843 29704 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:47:50.783584 29728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:50.783751 29704 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:47:50.783826 29704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "e11f58dcf789429a89398363f21d4ed7"
format_stamp: "Formatted at 2026-08-09 18:47:50 on dist-test-slave-45dx"
server_key: "e62a84b7b9e902a72271c0330249820b"
server_key_iv: "66493d02dcb32185bc215ff332bd51e8"
server_key_version: "encryptionkey@0"
I20260809 18:47:50.783883 29704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:50.787053 29704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:50.787261 29704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:50.787361 29704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:50.787505 29704 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:47:50.787744 29704 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:47:50.787774 29704 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:50.787794 29704 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:47:50.787806 29704 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:50.793607 29704 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:45435
I20260809 18:47:50.793725 29913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:45435 every 8 connection(s)
I20260809 18:47:50.793991 29704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:47:50.796968 29242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:50.794750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:36739 (local address 127.12.202.254:35985)
0809 18:47:50.794811 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:50.794813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:50.795055 (+ 242us) server_negotiation.cc:407] Connection header received
0809 18:47:50.795496 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:50.795498 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:50.795504 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:50.795565 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:50.796720 (+ 1155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:50.796722 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:50.796722 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:47:50.796726 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:50.796744 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:47:50.796748 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:50.796805 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:50.796901 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 18:47:50.796915 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 18:47:50.797091 29918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:50.794730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:35985 (local address 127.12.202.195:36739)
0809 18:47:50.794934 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:50.794964 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:50.795384 (+ 420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:50.795612 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:50.795615 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:50.795622 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:50.796583 (+ 961us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:47:50.796584 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:50.796610 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:47:50.796636 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:50.796805 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:50.796807 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:50.796809 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:47:50.796872 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 18:47:50.796915 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":90,"threads_started":1}
I20260809 18:47:50.797552 29915 heartbeater.cc:347] Connected to a master server at 127.12.202.254:35985
I20260809 18:47:50.797660 29915 heartbeater.cc:464] Registering TS with master...
I20260809 18:47:50.797806 29915 heartbeater.cc:511] Master 127.12.202.254:35985 requested a full tablet report, sending...
I20260809 18:47:50.798166 29176 ts_manager.cc:194] Registered new tserver with Master: e11f58dcf789429a89398363f21d4ed7 (127.12.202.195:45435)
I20260809 18:47:50.798663 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 29704
I20260809 18:47:50.798774 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:47:50.798935 13099 external_mini_cluster.cc:1428] Setting key cc00ae9d93c3288d085bea192863a821
I20260809 18:47:50.799748 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 18:47:50.802891 29242 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:47:50.802392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55548 (local address 127.12.202.254:35985)
0809 18:47:50.802462 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:50.802464 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:50.802555 (+ 91us) server_negotiation.cc:407] Connection header received
0809 18:47:50.802634 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:50.802635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:50.802640 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:50.802689 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:50.802801 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55548: BlockingRecv error: recv got EOF from 127.0.0.1:55548 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 18:47:50.803081 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 29277
I20260809 18:47:50.819190 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 29495
I20260809 18:47:50.840624 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 29704
I20260809 18:47:50.849259 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 29128
2026-08-09T18:47:50Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (621 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:47:50 dist-test-slave-45dx krb5kdc[29937](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:47:50 dist-test-slave-45dx krb5kdc[29937](info): set up 2 sockets
Aug 09 18:47:50 dist-test-slave-45dx krb5kdc[29937](info): commencing operation
krb5kdc: starting...
W20260809 18:47:52.102422 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.226s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:47:52 dist-test-slave-45dx krb5kdc[29937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:47:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:47:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:47:52.224574 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:38639
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:38639
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:47:52.309662 29958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:52.309859 29958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:52.309880 29958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:52.310905 29958 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:47:52.310937 29958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:52.310950 29958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:52.310962 29958 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:47:52.310974 29958 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:47:52.312359 29958 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:38639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:38639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:52.312556 29958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:52.312713 29958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:52.317555 29964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:52.317659 29958 server_base.cc:1034] running on GCE node
W20260809 18:47:52.317540 29972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:52.317539 29965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:52.318082 29958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:52.318372 29958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:52.319540 29958 hybrid_clock.cc:648] HybridClock initialized: now 1786301272319529 us; error 43 us; skew 500 ppm
Aug 09 18:47:52 dist-test-slave-45dx krb5kdc[29937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301272, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:47:52.322125 29958 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:47:52.322584 29958 webserver.cc:460] Webserver started at http://127.12.202.254:36579/ using document root <none> and password file <none>
I20260809 18:47:52.322804 29958 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:52.322882 29958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:52.323033 29958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:52.324059 29958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "fd4c357d07fa4a28a5b43930bdbddcfd"
format_stamp: "Formatted at 2026-08-09 18:47:52 on dist-test-slave-45dx"
server_key: "20fb175a183e497bc5c893ca87a1af72"
server_key_iv: "f10e1e16266b1fd0771108646d517733"
server_key_version: "encryptionkey@0"
I20260809 18:47:52.324469 29958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "fd4c357d07fa4a28a5b43930bdbddcfd"
format_stamp: "Formatted at 2026-08-09 18:47:52 on dist-test-slave-45dx"
server_key: "20fb175a183e497bc5c893ca87a1af72"
server_key_iv: "f10e1e16266b1fd0771108646d517733"
server_key_version: "encryptionkey@0"
I20260809 18:47:52.325754 29958 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:47:52.326524 29981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:52.326740 29958 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:47:52.326869 29958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "fd4c357d07fa4a28a5b43930bdbddcfd"
format_stamp: "Formatted at 2026-08-09 18:47:52 on dist-test-slave-45dx"
server_key: "20fb175a183e497bc5c893ca87a1af72"
server_key_iv: "f10e1e16266b1fd0771108646d517733"
server_key_version: "encryptionkey@0"
I20260809 18:47:52.326949 29958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:52.342396 29958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:52.344740 29958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:52.344911 29958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:52.349181 29958 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:38639
I20260809 18:47:52.349251 30072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:38639 every 8 connection(s)
I20260809 18:47:52.349607 29958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:47:52.350597 30073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:52.353543 30073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd: Bootstrap starting.
I20260809 18:47:52.354153 30073 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:52.354465 30073 log.cc:824] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd: Log is configured to *not* fsync() on all Append() calls
I20260809 18:47:52.355181 30073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd: No bootstrap required, opened a new log
I20260809 18:47:52.356906 30073 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd4c357d07fa4a28a5b43930bdbddcfd" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38639 } }
I20260809 18:47:52.357041 30073 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:52.357064 30073 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4c357d07fa4a28a5b43930bdbddcfd, State: Initialized, Role: FOLLOWER
I20260809 18:47:52.357230 30073 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd4c357d07fa4a28a5b43930bdbddcfd" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38639 } }
I20260809 18:47:52.357311 30073 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:47:52.357339 30073 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:47:52.357421 30073 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:52.358217 30073 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd4c357d07fa4a28a5b43930bdbddcfd" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38639 } }
I20260809 18:47:52.358302 30073 leader_election.cc:302] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd4c357d07fa4a28a5b43930bdbddcfd; no voters:
I20260809 18:47:52.358476 30073 leader_election.cc:288] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:47:52.358523 30076 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:47:52.358734 30076 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd [term 1 LEADER]: Becoming Leader. State: Replica: fd4c357d07fa4a28a5b43930bdbddcfd, State: Running, Role: LEADER
I20260809 18:47:52.358758 30073 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:47:52.358863 30076 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd4c357d07fa4a28a5b43930bdbddcfd" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38639 } }
I20260809 18:47:52.359302 30078 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd4c357d07fa4a28a5b43930bdbddcfd. Latest consensus state: current_term: 1 leader_uuid: "fd4c357d07fa4a28a5b43930bdbddcfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd4c357d07fa4a28a5b43930bdbddcfd" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38639 } } }
I20260809 18:47:52.359416 30078 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd [sys.catalog]: This master's current role is: LEADER
I20260809 18:47:52.359530 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 29958
I20260809 18:47:52.359289 30077 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd4c357d07fa4a28a5b43930bdbddcfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd4c357d07fa4a28a5b43930bdbddcfd" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38639 } } }
I20260809 18:47:52.359611 30077 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd [sys.catalog]: This master's current role is: LEADER
I20260809 18:47:52.359643 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:47:52.359807 30084 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:47:52.359890 13099 external_mini_cluster.cc:1428] Setting key 0ad13d7032146351efe2b9e0ad8b8558
I20260809 18:47:52.360396 30084 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:47:52.362073 30084 catalog_manager.cc:1347] Generated new cluster ID: d0088a85b4724e71b6472b7915b32850
I20260809 18:47:52.362128 30084 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:47:52 dist-test-slave-45dx krb5kdc[29937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:47:52.372184 30094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:52.360581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33340 (local address 127.12.202.254:38639)
0809 18:47:52.361282 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:52.361290 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:52.361314 (+ 24us) server_negotiation.cc:407] Connection header received
0809 18:47:52.361408 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:52.361412 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:52.361453 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:52.361621 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:52.362474 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.363815 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.364908 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.365519 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.365615 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:52.368430 (+ 2815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:52.368434 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:52.368435 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:52.368447 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:52.370508 (+ 2061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:52.370920 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:52.370922 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:52.370923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:52.371057 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:52.371288 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:52.371289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:52.371289 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:52.371592 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:52.371748 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:52.371823 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 18:47:52.371963 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":77,"threads_started":1}
I20260809 18:47:52.375847 30084 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:47:52.376478 30084 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:47:52.386667 30084 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd: Generated new TSK 0
I20260809 18:47:52.386842 30084 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
I20260809 18:47:52.419677 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:38639
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:47:52.501453 30109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:52.501642 30109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:52.501667 30109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:52.502823 30109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:52.502868 30109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:52.502926 30109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:47:52.504499 30109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:38639
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:52.504666 30109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:52.504918 30109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:52.509886 30115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:52.510046 30119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:52.510077 30116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:52.510370 30109 server_base.cc:1034] running on GCE node
I20260809 18:47:52.510538 30109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:52.510730 30109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:52.511864 30109 hybrid_clock.cc:648] HybridClock initialized: now 1786301272511841 us; error 39 us; skew 500 ppm
Aug 09 18:47:52 dist-test-slave-45dx krb5kdc[29937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301272, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:47:52.514425 30109 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:47:52.514880 30109 webserver.cc:460] Webserver started at http://127.12.202.193:36113/ using document root <none> and password file <none>
I20260809 18:47:52.515146 30109 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:52.515218 30109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:52.515372 30109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:52.516479 30109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "0cb2c8a939964d798f33a6de6a7e3062"
format_stamp: "Formatted at 2026-08-09 18:47:52 on dist-test-slave-45dx"
server_key: "f2371a7e3f117d699177fc019ceed4a4"
server_key_iv: "96329d5ae5e8ed0b54959a47bae2e83a"
server_key_version: "encryptionkey@0"
I20260809 18:47:52.516834 30109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "0cb2c8a939964d798f33a6de6a7e3062"
format_stamp: "Formatted at 2026-08-09 18:47:52 on dist-test-slave-45dx"
server_key: "f2371a7e3f117d699177fc019ceed4a4"
server_key_iv: "96329d5ae5e8ed0b54959a47bae2e83a"
server_key_version: "encryptionkey@0"
I20260809 18:47:52.518091 30109 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:47:52.518807 30131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:52.518978 30109 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:47:52.519083 30109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "0cb2c8a939964d798f33a6de6a7e3062"
format_stamp: "Formatted at 2026-08-09 18:47:52 on dist-test-slave-45dx"
server_key: "f2371a7e3f117d699177fc019ceed4a4"
server_key_iv: "96329d5ae5e8ed0b54959a47bae2e83a"
server_key_version: "encryptionkey@0"
I20260809 18:47:52.519164 30109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:52.535718 30109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:52.537662 30109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:52.537833 30109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:52.538075 30109 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:47:52.538384 30109 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:47:52.538439 30109 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:52.538480 30109 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:47:52.538502 30109 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:52.544535 30109 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:38797
I20260809 18:47:52.544593 30315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:38797 every 8 connection(s)
I20260809 18:47:52.544906 30109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
Aug 09 18:47:52 dist-test-slave-45dx krb5kdc[29937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301272, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:47:52.553841 30094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:52.545682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:47027 (local address 127.12.202.254:38639)
0809 18:47:52.545755 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:52.545758 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:52.545985 (+ 227us) server_negotiation.cc:407] Connection header received
0809 18:47:52.546481 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:52.546482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:52.546497 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:52.546549 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:52.547442 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.547931 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.548858 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.549050 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.549102 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:52.551104 (+ 2002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:52.551105 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:52.551106 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:52.551113 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:52.552573 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:52.552926 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:52.552927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:52.552927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:52.552981 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:52.553297 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:52.553298 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:52.553298 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:52.553407 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:52.553458 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:52.553707 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 18:47:52.553774 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:47:52.554065 30322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:52.545661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:38639 (local address 127.12.202.193:47027)
0809 18:47:52.545862 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:52.545898 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:52.546396 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:52.546599 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:52.546602 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:52.547155 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:52.547347 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:52.547352 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.548010 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.548011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:52.548777 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:52.548779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.549123 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.549124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:52.549215 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:52.549712 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:52.549720 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:52.551023 (+ 1303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:52.552638 (+ 1615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:52.552645 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:52.552646 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:52.552859 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:52.553071 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:52.553072 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:52.553072 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:52.553211 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:52.553472 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:52.553478 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:52.553592 (+ 114us) client_negotiation.cc:769] Sending connection context
0809 18:47:52.553680 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 18:47:52.553802 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":107,"threads_started":1}
I20260809 18:47:52.554634 30318 heartbeater.cc:347] Connected to a master server at 127.12.202.254:38639
I20260809 18:47:52.554714 30318 heartbeater.cc:464] Registering TS with master...
I20260809 18:47:52.554916 30318 heartbeater.cc:511] Master 127.12.202.254:38639 requested a full tablet report, sending...
I20260809 18:47:52.554975 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 30109
I20260809 18:47:52.555099 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:47:52.555336 13099 external_mini_cluster.cc:1428] Setting key d81d3054153b5743bb5dd62bb6c4fe8e
I20260809 18:47:52.555490 30014 ts_manager.cc:194] Registered new tserver with Master: 0cb2c8a939964d798f33a6de6a7e3062 (127.12.202.193:38797)
I20260809 18:47:52.556270 30014 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:47027
WARNING: no policy specified for kudu/127.12.202.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
I20260809 18:47:52.583451 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:38639
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:47:52.665146 30325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:52.665335 30325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:52.665360 30325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:52.666477 30325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:52.666518 30325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:52.666543 30325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:47:52.667987 30325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:38639
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:52.668244 30325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:52.668520 30325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:52.673575 30332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:52.673641 30335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:52.673679 30325 server_base.cc:1034] running on GCE node
W20260809 18:47:52.673583 30331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:52.674052 30325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:52.674252 30325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:52.675431 30325 hybrid_clock.cc:648] HybridClock initialized: now 1786301272675418 us; error 31 us; skew 500 ppm
Aug 09 18:47:52 dist-test-slave-45dx krb5kdc[29937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301272, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:47:52.677975 30325 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:47:52.678442 30325 webserver.cc:460] Webserver started at http://127.12.202.194:39183/ using document root <none> and password file <none>
I20260809 18:47:52.678711 30325 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:52.678805 30325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:52.678969 30325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:52.679987 30325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "cb6fcf7e3eb44eb9952423653faa9dca"
format_stamp: "Formatted at 2026-08-09 18:47:52 on dist-test-slave-45dx"
server_key: "4cbebeb5a5af341a2d375663e1721708"
server_key_iv: "1aa47144a149ffa6626b05a5bb375cfd"
server_key_version: "encryptionkey@0"
I20260809 18:47:52.680421 30325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "cb6fcf7e3eb44eb9952423653faa9dca"
format_stamp: "Formatted at 2026-08-09 18:47:52 on dist-test-slave-45dx"
server_key: "4cbebeb5a5af341a2d375663e1721708"
server_key_iv: "1aa47144a149ffa6626b05a5bb375cfd"
server_key_version: "encryptionkey@0"
I20260809 18:47:52.681780 30325 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:47:52.682551 30349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:52.682775 30325 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:47:52.682879 30325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "cb6fcf7e3eb44eb9952423653faa9dca"
format_stamp: "Formatted at 2026-08-09 18:47:52 on dist-test-slave-45dx"
server_key: "4cbebeb5a5af341a2d375663e1721708"
server_key_iv: "1aa47144a149ffa6626b05a5bb375cfd"
server_key_version: "encryptionkey@0"
I20260809 18:47:52.682962 30325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:52.690533 30325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:52.692448 30325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:52.692610 30325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:52.692816 30325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:47:52.693109 30325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:47:52.693187 30325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:52.693245 30325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:47:52.693274 30325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:52.699219 30325 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:35583
I20260809 18:47:52.699271 30550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:35583 every 8 connection(s)
I20260809 18:47:52.699550 30325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
Aug 09 18:47:52 dist-test-slave-45dx krb5kdc[29937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301272, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:47:52.708433 30094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:52.700188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:58417 (local address 127.12.202.254:38639)
0809 18:47:52.700249 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:52.700251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:52.700453 (+ 202us) server_negotiation.cc:407] Connection header received
0809 18:47:52.700912 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:52.700913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:52.700923 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:52.700979 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:52.701878 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.702361 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.703350 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.703532 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.703581 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:52.705761 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:52.705763 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:52.705763 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:52.705770 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:52.707196 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:52.707582 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:52.707583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:52.707584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:52.707636 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:52.707876 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:52.707876 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:52.707876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:52.707974 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:52.708025 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:52.708246 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 18:47:52.708360 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 18:47:52.708535 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 30325
I20260809 18:47:52.708626 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:47:52.708657 30554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:52.700131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:38639 (local address 127.12.202.194:58417)
0809 18:47:52.700297 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:52.700358 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:52.700830 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:52.701049 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:52.701051 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:52.701586 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:52.701774 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:52.701803 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.702448 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.702449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:52.703272 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:52.703274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.703609 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.703610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:52.703720 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:52.704194 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:52.704201 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:52.705670 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:52.707272 (+ 1602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:52.707278 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:52.707279 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:52.707505 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:52.707696 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:52.707697 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:52.707697 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:52.707818 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:52.708031 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:52.708035 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:52.708140 (+ 105us) client_negotiation.cc:769] Sending connection context
0809 18:47:52.708220 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 18:47:52.708406 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":99,"threads_started":1}
I20260809 18:47:52.708856 13099 external_mini_cluster.cc:1428] Setting key 6694949f8f851e30071d7c49cb583d22
I20260809 18:47:52.709169 30552 heartbeater.cc:347] Connected to a master server at 127.12.202.254:38639
I20260809 18:47:52.709270 30552 heartbeater.cc:464] Registering TS with master...
I20260809 18:47:52.709479 30552 heartbeater.cc:511] Master 127.12.202.254:38639 requested a full tablet report, sending...
I20260809 18:47:52.709844 30014 ts_manager.cc:194] Registered new tserver with Master: cb6fcf7e3eb44eb9952423653faa9dca (127.12.202.194:35583)
I20260809 18:47:52.710210 30014 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:58417
WARNING: no policy specified for kudu/127.12.202.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
I20260809 18:47:52.735702 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:38639
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:47:52.819900 30558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:47:52.820088 30558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:47:52.820163 30558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:47:52.821329 30558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:47:52.821370 30558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:47:52.821413 30558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:47:52.823019 30558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:38639
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:47:52.823259 30558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:47:52.823490 30558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:47:52.828655 30566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:47:52.828678 30567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:52.828871 30558 server_base.cc:1034] running on GCE node
W20260809 18:47:52.828889 30571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:47:52.829167 30558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:47:52.829432 30558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:47:52.830621 30558 hybrid_clock.cc:648] HybridClock initialized: now 1786301272830602 us; error 30 us; skew 500 ppm
Aug 09 18:47:52 dist-test-slave-45dx krb5kdc[29937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301272, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:47:52.833374 30558 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:47:52.833743 30558 webserver.cc:460] Webserver started at http://127.12.202.195:44635/ using document root <none> and password file <none>
I20260809 18:47:52.833942 30558 fs_manager.cc:359] Metadata directory not provided
I20260809 18:47:52.833983 30558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:47:52.834069 30558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:47:52.835017 30558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "8d4d6af498d14cb897175e9a06375e48"
format_stamp: "Formatted at 2026-08-09 18:47:52 on dist-test-slave-45dx"
server_key: "f7a8cf6e95df26f6633a5306a8d45f47"
server_key_iv: "ce0cbff277fff284e9bc5764781c2483"
server_key_version: "encryptionkey@0"
I20260809 18:47:52.835314 30558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "8d4d6af498d14cb897175e9a06375e48"
format_stamp: "Formatted at 2026-08-09 18:47:52 on dist-test-slave-45dx"
server_key: "f7a8cf6e95df26f6633a5306a8d45f47"
server_key_iv: "ce0cbff277fff284e9bc5764781c2483"
server_key_version: "encryptionkey@0"
I20260809 18:47:52.836606 30558 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:47:52.837263 30580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:52.837481 30558 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:47:52.837590 30558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "8d4d6af498d14cb897175e9a06375e48"
format_stamp: "Formatted at 2026-08-09 18:47:52 on dist-test-slave-45dx"
server_key: "f7a8cf6e95df26f6633a5306a8d45f47"
server_key_iv: "ce0cbff277fff284e9bc5764781c2483"
server_key_version: "encryptionkey@0"
I20260809 18:47:52.837684 30558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:47:52.845873 30558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:47:52.847638 30558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:47:52.847803 30558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:47:52.848032 30558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:47:52.848387 30558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:47:52.848453 30558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:52.848495 30558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:47:52.848520 30558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:47:52.854447 30558 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:46347
I20260809 18:47:52.854485 30773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:46347 every 8 connection(s)
I20260809 18:47:52.854805 30558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:47:52.860915 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 30558
I20260809 18:47:52.861028 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:47:52.861258 13099 external_mini_cluster.cc:1428] Setting key dd82e544bff50cdc4910792c82fe756d
Aug 09 18:47:52 dist-test-slave-45dx krb5kdc[29937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301272, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:47:52.864892 30094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:52.855553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:34037 (local address 127.12.202.254:38639)
0809 18:47:52.855622 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:52.855624 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:52.855832 (+ 208us) server_negotiation.cc:407] Connection header received
0809 18:47:52.856349 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:52.856350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:52.856362 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:52.856430 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:52.857403 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.857898 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.858995 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.859176 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.859227 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:52.861944 (+ 2717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:52.861945 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:52.861946 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:52.861953 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:52.863553 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:52.863929 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:52.863929 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:52.863930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:52.863986 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:52.864269 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:52.864270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:52.864270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:52.864438 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:52.864496 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:52.864741 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 18:47:52.864827 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 18:47:52.865083 30776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:52.855518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:38639 (local address 127.12.202.195:34037)
0809 18:47:52.855699 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:52.855739 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:52.856221 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:52.856496 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:52.856499 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:52.857106 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:47:52.857297 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:52.857301 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.857982 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.857983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:52.858920 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:52.858923 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.859249 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.859250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:52.859413 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:52.859965 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:47:52.859972 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:47:52.861866 (+ 1894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:47:52.863629 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:52.863634 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:52.863636 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:52.863857 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:52.864082 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:47:52.864083 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:47:52.864084 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:47:52.864196 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:47:52.864503 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:47:52.864508 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:47:52.864622 (+ 114us) client_negotiation.cc:769] Sending connection context
0809 18:47:52.864713 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 18:47:52.864848 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":110,"threads_started":1}
I20260809 18:47:52.865604 30774 heartbeater.cc:347] Connected to a master server at 127.12.202.254:38639
I20260809 18:47:52.865693 30774 heartbeater.cc:464] Registering TS with master...
I20260809 18:47:52.865908 30774 heartbeater.cc:511] Master 127.12.202.254:38639 requested a full tablet report, sending...
I20260809 18:47:52.866297 30014 ts_manager.cc:194] Registered new tserver with Master: 8d4d6af498d14cb897175e9a06375e48 (127.12.202.195:46347)
I20260809 18:47:52.866693 30014 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:34037
I20260809 18:47:52.873149 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:47:52.880579 30094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:52.874598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33342 (local address 127.12.202.254:38639)
0809 18:47:52.874685 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:52.874688 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:52.874782 (+ 94us) server_negotiation.cc:407] Connection header received
0809 18:47:52.874819 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:52.874820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:52.874829 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:52.874879 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:47:52.875447 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.875922 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.876644 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.876833 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.876892 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:52.877989 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:47:52.877990 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:47:52.877990 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:47:52.877996 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:47:52.879394 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:52.879760 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:52.879761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:52.879761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:52.879818 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:47:52.879995 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:47:52.879995 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:47:52.879996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:47:52.880133 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:47:52.880210 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:52.880296 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 18:47:52.880441 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 18:47:52.882063 30014 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33342:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:47:52.883626 30014 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:47:52.889968 30785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:52.885834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:46347 (local address 127.0.0.1:57184)
0809 18:47:52.885959 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:52.885998 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:52.886066 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:52.886523 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:52.886524 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:52.886526 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:47:52.886556 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:52.886557 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.887940 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.887940 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:52.888944 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:52.888947 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.889753 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.889754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:52.889820 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:52.889830 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 18:47:52.889882 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 18:47:52.889917 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":80,"threads_started":1}
I20260809 18:47:52.890058 30790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:52.886053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57184 (local address 127.12.202.195:46347)
0809 18:47:52.886239 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:52.886245 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:52.886256 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:47:52.886292 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:52.886294 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:52.886312 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:52.886633 (+ 321us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:47:52.886706 (+ 73us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.887800 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.889023 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.889671 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.889749 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:52.889799 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:52.889913 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 18:47:52.889951 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":109,"threads_started":1}
I20260809 18:47:52.890692 30660 tablet_service.cc:1467] Processing CreateTablet for tablet ee260007fb4d4602ba55efe52bd38210 (DEFAULT_TABLE table=test-table [id=d9313015eda04b8080229565e5f1cdb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:47:52.891069 30660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee260007fb4d4602ba55efe52bd38210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:52.891070 30786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:52.885899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:38797 (local address 127.0.0.1:49134)
0809 18:47:52.886333 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:52.886343 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:52.886400 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:52.886700 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:52.886701 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:52.886704 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:47:52.886790 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:52.886791 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.887817 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.887818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:52.889163 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:52.889167 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.890808 (+ 1641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.890809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:52.890884 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:52.890890 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 18:47:52.890948 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 18:47:52.890993 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"mutex_wait_us":47,"thread_start_us":57,"threads_started":1}
I20260809 18:47:52.891197 30787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:52.885884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:35583 (local address 127.0.0.1:55432)
0809 18:47:52.886000 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:52.886012 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:52.886066 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:52.886479 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:52.886482 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:52.886485 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:47:52.886551 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:52.886553 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.887948 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.887949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:52.889163 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:52.889167 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.890909 (+ 1742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.890910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:52.890978 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:52.890983 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:47:52.891013 (+ 30us) client_negotiation.cc:240] Negotiation successful
0809 18:47:52.891053 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":53,"thread_start_us":56,"threads_started":1}
I20260809 18:47:52.891371 30792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:52.886111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55432 (local address 127.12.202.194:35583)
0809 18:47:52.886298 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:52.886302 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:52.886311 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:47:52.886348 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:52.886350 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:52.886365 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:52.886633 (+ 268us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:47:52.886746 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.887842 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.889262 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.889977 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.891130 (+ 1153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:52.891196 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:52.891224 (+ 28us) server_negotiation.cc:299] Negotiation successful
0809 18:47:52.891278 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":82,"threads_started":1}
I20260809 18:47:52.891815 30794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:52.886335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49134 (local address 127.12.202.193:38797)
0809 18:47:52.886518 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:52.886523 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:52.886532 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:47:52.886581 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:52.886583 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:52.886598 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:52.886872 (+ 274us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:47:52.886938 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.887681 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.890066 (+ 2385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.890681 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.890786 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:52.890846 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:52.891673 (+ 827us) server_negotiation.cc:299] Negotiation successful
0809 18:47:52.891720 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":85,"threads_started":1}
I20260809 18:47:52.891999 30434 tablet_service.cc:1467] Processing CreateTablet for tablet ee260007fb4d4602ba55efe52bd38210 (DEFAULT_TABLE table=test-table [id=d9313015eda04b8080229565e5f1cdb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:47:52.892369 30434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee260007fb4d4602ba55efe52bd38210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:52.892468 30211 tablet_service.cc:1467] Processing CreateTablet for tablet ee260007fb4d4602ba55efe52bd38210 (DEFAULT_TABLE table=test-table [id=d9313015eda04b8080229565e5f1cdb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:47:52.892788 30211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee260007fb4d4602ba55efe52bd38210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:47:52.894307 30795 tablet_bootstrap.cc:492] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48: Bootstrap starting.
I20260809 18:47:52.894958 30795 tablet_bootstrap.cc:654] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:52.895479 30795 log.cc:824] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48: Log is configured to *not* fsync() on all Append() calls
I20260809 18:47:52.896212 30805 tablet_bootstrap.cc:492] T ee260007fb4d4602ba55efe52bd38210 P 0cb2c8a939964d798f33a6de6a7e3062: Bootstrap starting.
I20260809 18:47:52.896266 30795 tablet_bootstrap.cc:492] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48: No bootstrap required, opened a new log
I20260809 18:47:52.896358 30795 ts_tablet_manager.cc:1397] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:47:52.896343 30797 tablet_bootstrap.cc:492] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca: Bootstrap starting.
I20260809 18:47:52.896924 30805 tablet_bootstrap.cc:654] T ee260007fb4d4602ba55efe52bd38210 P 0cb2c8a939964d798f33a6de6a7e3062: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:52.896945 30797 tablet_bootstrap.cc:654] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca: Neither blocks nor log segments found. Creating new log.
I20260809 18:47:52.897539 30805 log.cc:824] T ee260007fb4d4602ba55efe52bd38210 P 0cb2c8a939964d798f33a6de6a7e3062: Log is configured to *not* fsync() on all Append() calls
I20260809 18:47:52.897539 30797 log.cc:824] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca: Log is configured to *not* fsync() on all Append() calls
I20260809 18:47:52.898300 30797 tablet_bootstrap.cc:492] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca: No bootstrap required, opened a new log
I20260809 18:47:52.898377 30797 ts_tablet_manager.cc:1397] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:47:52.898427 30795 raft_consensus.cc:348] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d4d6af498d14cb897175e9a06375e48" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46347 } } peers { permanent_uuid: "cb6fcf7e3eb44eb9952423653faa9dca" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35583 } } peers { permanent_uuid: "0cb2c8a939964d798f33a6de6a7e3062" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38797 } }
I20260809 18:47:52.898561 30805 tablet_bootstrap.cc:492] T ee260007fb4d4602ba55efe52bd38210 P 0cb2c8a939964d798f33a6de6a7e3062: No bootstrap required, opened a new log
I20260809 18:47:52.898600 30795 raft_consensus.cc:374] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:52.898622 30805 ts_tablet_manager.cc:1397] T ee260007fb4d4602ba55efe52bd38210 P 0cb2c8a939964d798f33a6de6a7e3062: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:47:52.898645 30795 raft_consensus.cc:729] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d4d6af498d14cb897175e9a06375e48, State: Initialized, Role: FOLLOWER
I20260809 18:47:52.898780 30795 consensus_queue.cc:260] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d4d6af498d14cb897175e9a06375e48" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46347 } } peers { permanent_uuid: "cb6fcf7e3eb44eb9952423653faa9dca" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35583 } } peers { permanent_uuid: "0cb2c8a939964d798f33a6de6a7e3062" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38797 } }
I20260809 18:47:52.899067 30795 ts_tablet_manager.cc:1428] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:47:52.899211 30774 heartbeater.cc:503] Master 127.12.202.254:38639 was elected leader, sending a full tablet report...
I20260809 18:47:52.900388 30797 raft_consensus.cc:348] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d4d6af498d14cb897175e9a06375e48" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46347 } } peers { permanent_uuid: "cb6fcf7e3eb44eb9952423653faa9dca" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35583 } } peers { permanent_uuid: "0cb2c8a939964d798f33a6de6a7e3062" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38797 } }
I20260809 18:47:52.900561 30797 raft_consensus.cc:374] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:52.900599 30797 raft_consensus.cc:729] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb6fcf7e3eb44eb9952423653faa9dca, State: Initialized, Role: FOLLOWER
I20260809 18:47:52.900745 30797 consensus_queue.cc:260] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d4d6af498d14cb897175e9a06375e48" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46347 } } peers { permanent_uuid: "cb6fcf7e3eb44eb9952423653faa9dca" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35583 } } peers { permanent_uuid: "0cb2c8a939964d798f33a6de6a7e3062" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38797 } }
I20260809 18:47:52.900682 30805 raft_consensus.cc:348] T ee260007fb4d4602ba55efe52bd38210 P 0cb2c8a939964d798f33a6de6a7e3062 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d4d6af498d14cb897175e9a06375e48" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46347 } } peers { permanent_uuid: "cb6fcf7e3eb44eb9952423653faa9dca" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35583 } } peers { permanent_uuid: "0cb2c8a939964d798f33a6de6a7e3062" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38797 } }
I20260809 18:47:52.900830 30805 raft_consensus.cc:374] T ee260007fb4d4602ba55efe52bd38210 P 0cb2c8a939964d798f33a6de6a7e3062 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:47:52.900882 30805 raft_consensus.cc:729] T ee260007fb4d4602ba55efe52bd38210 P 0cb2c8a939964d798f33a6de6a7e3062 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cb2c8a939964d798f33a6de6a7e3062, State: Initialized, Role: FOLLOWER
I20260809 18:47:52.901026 30797 ts_tablet_manager.cc:1428] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:47:52.901047 30552 heartbeater.cc:503] Master 127.12.202.254:38639 was elected leader, sending a full tablet report...
I20260809 18:47:52.901018 30805 consensus_queue.cc:260] T ee260007fb4d4602ba55efe52bd38210 P 0cb2c8a939964d798f33a6de6a7e3062 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d4d6af498d14cb897175e9a06375e48" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46347 } } peers { permanent_uuid: "cb6fcf7e3eb44eb9952423653faa9dca" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35583 } } peers { permanent_uuid: "0cb2c8a939964d798f33a6de6a7e3062" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38797 } }
I20260809 18:47:52.901325 30318 heartbeater.cc:503] Master 127.12.202.254:38639 was elected leader, sending a full tablet report...
I20260809 18:47:52.901317 30805 ts_tablet_manager.cc:1428] T ee260007fb4d4602ba55efe52bd38210 P 0cb2c8a939964d798f33a6de6a7e3062: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260809 18:47:52.950191 30553 tablet.cc:2369] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:47:52.986414 30809 raft_consensus.cc:482] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:47:52.986552 30809 raft_consensus.cc:504] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d4d6af498d14cb897175e9a06375e48" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46347 } } peers { permanent_uuid: "cb6fcf7e3eb44eb9952423653faa9dca" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35583 } } peers { permanent_uuid: "0cb2c8a939964d798f33a6de6a7e3062" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38797 } }
I20260809 18:47:52.987002 30809 leader_election.cc:288] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb6fcf7e3eb44eb9952423653faa9dca (127.12.202.194:35583), 0cb2c8a939964d798f33a6de6a7e3062 (127.12.202.193:38797)
I20260809 18:47:52.991024 30776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:52.987177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:38797 (local address 127.12.202.195:47675)
0809 18:47:52.987225 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:52.987238 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:52.987284 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:52.987473 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:52.987474 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:52.987476 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:47:52.987549 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:52.987551 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.988586 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.988586 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:52.989948 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:52.989951 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.990715 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.990716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:52.990799 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:52.990800 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 18:47:52.990862 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 18:47:52.990910 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":97}
I20260809 18:47:52.991034 30812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:52.987187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:35583 (local address 127.12.202.195:53385)
0809 18:47:52.987398 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:52.987405 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0809 18:47:52.987472 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:47:52.987603 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:47:52.987604 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:47:52.987606 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:47:52.987672 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:52.987673 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.988585 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.988586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:52.989948 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:47:52.989951 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.990715 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.990716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:47:52.990796 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:52.990800 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:47:52.990861 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 18:47:52.990910 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":88,"thread_start_us":134,"threads_started":1}
I20260809 18:47:52.991079 30792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:52.987296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:53385 (local address 127.12.202.194:35583)
0809 18:47:52.987339 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:52.987341 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:52.987490 (+ 149us) server_negotiation.cc:407] Connection header received
0809 18:47:52.987522 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:52.987523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:52.987537 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:52.987580 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:47:52.987735 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.988494 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.990057 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.990621 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.990702 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:52.990710 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:52.990925 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 18:47:52.990974 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:47:52.991072 30794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:52.987262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:47675 (local address 127.12.202.193:38797)
0809 18:47:52.987313 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:52.987315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:52.987352 (+ 37us) server_negotiation.cc:407] Connection header received
0809 18:47:52.987388 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:52.987389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:52.987396 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:52.987440 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:47:52.987653 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.988494 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.990057 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:52.990621 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:52.990702 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:52.990710 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:52.990925 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 18:47:52.990975 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 18:47:52.991496 30246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee260007fb4d4602ba55efe52bd38210" candidate_uuid: "8d4d6af498d14cb897175e9a06375e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cb2c8a939964d798f33a6de6a7e3062" is_pre_election: true
I20260809 18:47:52.991606 30468 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee260007fb4d4602ba55efe52bd38210" candidate_uuid: "8d4d6af498d14cb897175e9a06375e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb6fcf7e3eb44eb9952423653faa9dca" is_pre_election: true
I20260809 18:47:52.991703 30246 raft_consensus.cc:2454] T ee260007fb4d4602ba55efe52bd38210 P 0cb2c8a939964d798f33a6de6a7e3062 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d4d6af498d14cb897175e9a06375e48 in term 0.
I20260809 18:47:52.991788 30468 raft_consensus.cc:2454] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d4d6af498d14cb897175e9a06375e48 in term 0.
I20260809 18:47:52.992031 30585 leader_election.cc:302] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d4d6af498d14cb897175e9a06375e48, cb6fcf7e3eb44eb9952423653faa9dca; no voters:
I20260809 18:47:52.992166 30809 raft_consensus.cc:2781] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:47:52.992223 30809 raft_consensus.cc:482] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:47:52.992250 30809 raft_consensus.cc:3037] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:52.993016 30809 raft_consensus.cc:504] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d4d6af498d14cb897175e9a06375e48" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46347 } } peers { permanent_uuid: "cb6fcf7e3eb44eb9952423653faa9dca" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35583 } } peers { permanent_uuid: "0cb2c8a939964d798f33a6de6a7e3062" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38797 } }
I20260809 18:47:52.993155 30809 leader_election.cc:288] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [CANDIDATE]: Term 1 election: Requested vote from peers cb6fcf7e3eb44eb9952423653faa9dca (127.12.202.194:35583), 0cb2c8a939964d798f33a6de6a7e3062 (127.12.202.193:38797)
I20260809 18:47:52.993356 30468 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee260007fb4d4602ba55efe52bd38210" candidate_uuid: "8d4d6af498d14cb897175e9a06375e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb6fcf7e3eb44eb9952423653faa9dca"
I20260809 18:47:52.993446 30468 raft_consensus.cc:3037] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:52.993479 30246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee260007fb4d4602ba55efe52bd38210" candidate_uuid: "8d4d6af498d14cb897175e9a06375e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cb2c8a939964d798f33a6de6a7e3062"
I20260809 18:47:52.993579 30246 raft_consensus.cc:3037] T ee260007fb4d4602ba55efe52bd38210 P 0cb2c8a939964d798f33a6de6a7e3062 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:47:52.994204 30468 raft_consensus.cc:2454] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d4d6af498d14cb897175e9a06375e48 in term 1.
I20260809 18:47:52.994397 30585 leader_election.cc:302] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d4d6af498d14cb897175e9a06375e48, cb6fcf7e3eb44eb9952423653faa9dca; no voters:
I20260809 18:47:52.994513 30809 raft_consensus.cc:2781] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:47:52.994515 30246 raft_consensus.cc:2454] T ee260007fb4d4602ba55efe52bd38210 P 0cb2c8a939964d798f33a6de6a7e3062 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d4d6af498d14cb897175e9a06375e48 in term 1.
I20260809 18:47:52.994683 30809 raft_consensus.cc:686] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [term 1 LEADER]: Becoming Leader. State: Replica: 8d4d6af498d14cb897175e9a06375e48, State: Running, Role: LEADER
I20260809 18:47:52.994818 30809 consensus_queue.cc:237] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d4d6af498d14cb897175e9a06375e48" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46347 } } peers { permanent_uuid: "cb6fcf7e3eb44eb9952423653faa9dca" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35583 } } peers { permanent_uuid: "0cb2c8a939964d798f33a6de6a7e3062" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38797 } }
I20260809 18:47:52.995875 30011 catalog_manager.cc:5495] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d4d6af498d14cb897175e9a06375e48 (127.12.202.195). New cstate: current_term: 1 leader_uuid: "8d4d6af498d14cb897175e9a06375e48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d4d6af498d14cb897175e9a06375e48" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb6fcf7e3eb44eb9952423653faa9dca" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cb2c8a939964d798f33a6de6a7e3062" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38797 } health_report { overall_health: UNKNOWN } } }
I20260809 18:47:53.004199 30790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:53.002174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57200 (local address 127.12.202.195:46347)
0809 18:47:53.002224 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 18:47:53.002226 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:47:53.002235 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:47:53.002270 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:47:53.002271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:47:53.002286 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:47:53.002347 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:47:53.002469 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:53.002905 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:53.003583 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:47:53.003762 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:47:53.003814 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:47:53.003956 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:47:53.004044 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:47:53.004102 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 18:47:53.004136 (+ 34us) server_negotiation.cc:299] Negotiation successful
0809 18:47:53.004151 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 18:47:53.005899 30246 raft_consensus.cc:1261] T ee260007fb4d4602ba55efe52bd38210 P 0cb2c8a939964d798f33a6de6a7e3062 [term 1 FOLLOWER]: Refusing update from remote peer 8d4d6af498d14cb897175e9a06375e48: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:47:53.005930 30468 raft_consensus.cc:1261] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca [term 1 FOLLOWER]: Refusing update from remote peer 8d4d6af498d14cb897175e9a06375e48: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:47:53.006275 30813 consensus_queue.cc:1035] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb6fcf7e3eb44eb9952423653faa9dca" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:47:53.006407 30809 consensus_queue.cc:1035] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cb2c8a939964d798f33a6de6a7e3062" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:47:53.008651 30819 mvcc.cc:205] Tried to move back new op lower bound from 7316690014229573632 to 7316690014187671552. Current Snapshot: MvccSnapshot[applied={T|T < 7316690014229573632}]
I20260809 18:47:53.008890 30822 mvcc.cc:205] Tried to move back new op lower bound from 7316690014229573632 to 7316690014187671552. Current Snapshot: MvccSnapshot[applied={T|T < 7316690014229573632}]
I20260809 18:47:53.011605 30014 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33342:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:47:53.011693 30014 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33342:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:47:53.012483 30014 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fd4c357d07fa4a28a5b43930bdbddcfd: Sending DeleteTablet for 3 replicas of tablet ee260007fb4d4602ba55efe52bd38210
I20260809 18:47:53.012813 30660 tablet_service.cc:1514] Processing DeleteTablet for tablet ee260007fb4d4602ba55efe52bd38210 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:47:53 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:57184
I20260809 18:47:53.012847 30434 tablet_service.cc:1514] Processing DeleteTablet for tablet ee260007fb4d4602ba55efe52bd38210 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:47:53 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:55432
I20260809 18:47:53.013033 30211 tablet_service.cc:1514] Processing DeleteTablet for tablet ee260007fb4d4602ba55efe52bd38210 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:47:53 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:49134
I20260809 18:47:53.013074 30839 tablet_replica.cc:330] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca: stopping tablet replica
I20260809 18:47:53.013269 30843 tablet_replica.cc:330] T ee260007fb4d4602ba55efe52bd38210 P 0cb2c8a939964d798f33a6de6a7e3062: stopping tablet replica
I20260809 18:47:53.013166 30839 raft_consensus.cc:2229] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:47:53.013360 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 30109
I20260809 18:47:53.013372 30843 raft_consensus.cc:2229] T ee260007fb4d4602ba55efe52bd38210 P 0cb2c8a939964d798f33a6de6a7e3062 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:47:53.013403 30839 raft_consensus.cc:2258] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:47:53.013464 30843 raft_consensus.cc:2258] T ee260007fb4d4602ba55efe52bd38210 P 0cb2c8a939964d798f33a6de6a7e3062 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:47:53.027061 30838 tablet_replica.cc:330] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48: stopping tablet replica
I20260809 18:47:53.027245 30838 raft_consensus.cc:2229] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:47:53.027366 30838 raft_consensus.cc:2258] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:47:53.027872 30839 ts_tablet_manager.cc:1905] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:47:53.027969 30838 ts_tablet_manager.cc:1905] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:47:53.029860 30839 ts_tablet_manager.cc:1918] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:47:53.029860 30838 ts_tablet_manager.cc:1918] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:47:53.029954 30838 log.cc:1196] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/ee260007fb4d4602ba55efe52bd38210
I20260809 18:47:53.030071 30839 log.cc:1196] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/ee260007fb4d4602ba55efe52bd38210
I20260809 18:47:53.030263 30838 ts_tablet_manager.cc:1939] T ee260007fb4d4602ba55efe52bd38210 P 8d4d6af498d14cb897175e9a06375e48: Deleting consensus metadata
I20260809 18:47:53.030480 30839 ts_tablet_manager.cc:1939] T ee260007fb4d4602ba55efe52bd38210 P cb6fcf7e3eb44eb9952423653faa9dca: Deleting consensus metadata
I20260809 18:47:53.030718 29984 catalog_manager.cc:4841] TS 8d4d6af498d14cb897175e9a06375e48 (127.12.202.195:46347): tablet ee260007fb4d4602ba55efe52bd38210 (table test-table [id=d9313015eda04b8080229565e5f1cdb7]) successfully deleted
I20260809 18:47:53.031087 29986 catalog_manager.cc:4841] TS cb6fcf7e3eb44eb9952423653faa9dca (127.12.202.194:35583): tablet ee260007fb4d4602ba55efe52bd38210 (table test-table [id=d9313015eda04b8080229565e5f1cdb7]) successfully deleted
W20260809 18:47:53.032833 29988 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.202.193:38797 (error 108)
I20260809 18:47:53.033107 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 30325
I20260809 18:47:53.033356 30787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:47:53.033213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:38797 (local address 127.0.0.1:49150)
0809 18:47:53.033265 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 18:47:53.033317 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:38797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260809 18:47:53.037635 29988 catalog_manager.cc:4584] TS 0cb2c8a939964d798f33a6de6a7e3062 (127.12.202.193:38797): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ee260007fb4d4602ba55efe52bd38210: Network error: Client connection negotiation failed: client connection to 127.12.202.193:38797: connect: Connection refused (error 111)
I20260809 18:47:53.042253 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 30558
I20260809 18:47:53.053529 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 29958
2026-08-09T18:47:53Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2202 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:47:53 dist-test-slave-45dx krb5kdc[30852](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:47:53 dist-test-slave-45dx krb5kdc[30852](info): set up 2 sockets
Aug 09 18:47:53 dist-test-slave-45dx krb5kdc[30852](info): commencing operation
krb5kdc: starting...
W20260809 18:47:54.334061 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:47:54 dist-test-slave-45dx krb5kdc[30852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301274, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:47:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:47:54Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.202.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.202.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.202.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/rangeradmin_127.12.202.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.202.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/rangeradmin_127.12.202.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.202.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.202.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.202.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/rangerlookup_127.12.202.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.202.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/rangerlookup_127.12.202.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.202.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.202.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.202.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/HTTP_127.12.202.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.202.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/HTTP_127.12.202.212@KRBTEST.COM.keytab.
I20260809 18:47:54.504932 13099 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskr0scnw/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/postgres -l logfile start
2026-08-09 18:47:57.016 UTC [30898] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 18:47:57.016 UTC [30898] LOG: listening on IPv4 address "127.12.202.212", port 35727
2026-08-09 18:47:57.020 UTC [30898] LOG: listening on Unix socket "/tmp/.s.PGSQL.35727"
2026-08-09 18:47:57.043 UTC [30901] LOG: database system was shut down at 2026-08-09 18:47:55 UTC
2026-08-09 18:47:57.047 UTC [30898] LOG: database system is ready to accept connections
I20260809 18:47:58.220767 13099 mini_postgres.cc:96] Postgres bound to 35727
2026-08-09 18:47:58.228 UTC [30912] FATAL: database "slave" does not exist
127.12.202.212:35727 - accepting connections
I20260809 18:47:58.229588 13099 mini_ranger.cc:161] Starting Ranger...
I20260809 18:47:58.246095 13099 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 18:47:58.719461 13099 mini_ranger.cc:87] Created ranger Postgres database
I20260809 18:47:58.719558 13099 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ranger-admin
2026-08-09 18:47:59,018 [I] DB FLAVOR :POSTGRES
2026-08-09 18:47:59,019 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 18:47:59,019 [I] Checking connection..
2026-08-09 18:47:59,019 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 18:47:59,285 [I] Checking connection passed.
2026-08-09 18:47:59,285 [I] --------- Verifying version history table ---------
2026-08-09 18:47:59,285 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 18:47:59,556 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 18:47:59,556 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 18:47:59,824 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 18:47:59,824 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 18:47:59,824 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 18:48:00.095 UTC [31018] WARNING: there is no transaction in progress
2026-08-09 18:48:00,105 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 18:48:00,106 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 18:48:00,379 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 18:48:00,379 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 18:48:00,379 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 18:48:00,664 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 18:48:00,935 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-45dx.c.gcp-upstream.internal','N') ;"
2026-08-09 18:48:01,198 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 18:48:01,440 [I] Table x_portal_user does not exist in database ranger
2026-08-09 18:48:01,440 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 18:48:01,708 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 18:48:01,708 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 18:48:01,970 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 18:48:02,229 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 18:48:02,229 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 18:48:03.231 UTC [31202] WARNING: there is no transaction in progress
2026-08-09 18:48:03.247 UTC [31202] WARNING: there is no transaction in progress
2026-08-09 18:48:03.262 UTC [31202] WARNING: there is no transaction in progress
2026-08-09 18:48:03.278 UTC [31202] WARNING: there is no transaction in progress
2026-08-09 18:48:03.293 UTC [31202] WARNING: there is no transaction in progress
2026-08-09 18:48:03.310 UTC [31202] WARNING: there is no transaction in progress
2026-08-09 18:48:03.366 UTC [31202] WARNING: there is no transaction in progress
2026-08-09 18:48:03.373 UTC [31202] WARNING: there is no transaction in progress
2026-08-09 18:48:03.387 UTC [31202] WARNING: there is no transaction in progress
2026-08-09 18:48:03.397 UTC [31202] WARNING: there is no transaction in progress
2026-08-09 18:48:03.408 UTC [31202] WARNING: there is no transaction in progress
2026-08-09 18:48:03.422 UTC [31202] WARNING: there is no transaction in progress
2026-08-09 18:48:03.432 UTC [31202] WARNING: there is no transaction in progress
2026-08-09 18:48:03.438 UTC [31202] WARNING: there is no transaction in progress
2026-08-09 18:48:03.445 UTC [31202] WARNING: there is no transaction in progress
2026-08-09 18:48:03.451 UTC [31202] WARNING: there is no transaction in progress
2026-08-09 18:48:04,075 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 18:48:04,076 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 18:48:04,333 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 18:48:04,334 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 18:48:04,588 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 18:48:04,588 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 18:48:04,860 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 18:48:04,861 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 18:48:05,120 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 18:48:05,368 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-45dx.c.gcp-upstream.internal';"
2026-08-09 18:48:05,598 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 18:48:05,598 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 18:48:05,861 [I] DB_PATCHES have already been applied
I20260809 18:48:05.867123 13099 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ranger-admin:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskr0scnw/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 18:48:05.867194 13099 mini_ranger.cc:193] Using host: 127.12.202.212
I20260809 18:48:05.871075 13099 mini_ranger.cc:227] Ranger admin URL: http://127.12.202.212:55137
Aug 09, 2026 6:48:06 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:48:06 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:48:06 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 6:48:06 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 6:48:06 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 6:48:06 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 6:48:06 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 18:48:07.262147 13099 mini_ranger.cc:160] Time spent starting Ranger: real 9.033s user 0.008s sys 0.004s
Aug 09, 2026 6:48:28 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 6:48:28 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 6:48:28 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 6:48:28 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 6:48:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 6:48:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 6:48:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 6:48:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 6:48:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 6:48:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 6:48:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 6:48:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 6:48:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 6:48:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 6:48:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 6:48:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 6:48:28 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 6:48:29 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 18:48:30.066890 13099 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.202.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.202.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.202.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/rangerkms_127.12.202.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.202.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/rangerkms_127.12.202.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.202.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.202.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.202.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/HTTP_127.12.202.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.202.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/HTTP_127.12.202.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 18:48:30 dist-test-slave-45dx krb5kdc[30852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301310, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 18:48:30.152274 13099 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 18:48:30.163251 13099 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 18:48:30.980729 13099 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 18:48:30.980837 13099 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ranger-kms
I20260809 18:48:30.980860 13099 mini_ranger_kms.cc:227] Using postgres at 127.12.202.212:35727
2026-08-09 18:48:31,311 [I] DB FLAVOR :POSTGRES
2026-08-09 18:48:31,311 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 18:48:31,311 [I] Checking connection
2026-08-09 18:48:31,311 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 18:48:31,557 [I] connection success
2026-08-09 18:48:31,557 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 18:48:31,557 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 18:48:31,558 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 18:48:31,790 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 18:48:31,790 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 18:48:31,790 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 18:48:31,791 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:35727/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 18:48:32,069 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 18:48:32.547220 13099 mini_ranger_kms.cc:310] Created kms service
I20260809 18:48:32.767158 13099 mini_ranger_kms.cc:326] Created kudu user
I20260809 18:48:32.811982 13099 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 18:48:32 dist-test-slave-45dx krb5kdc[30852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301310, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
I20260809 18:48:33.263784 13099 mini_ranger_kms.cc:384] Added ranger policy
I20260809 18:48:33.263904 13099 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ranger-kms:/tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 18:48:33.263924 13099 mini_ranger_kms.cc:240] Using host: 127.12.202.212
I20260809 18:48:33.268170 13099 mini_ranger_kms.cc:276] Ranger KMS PID: 31520
I20260809 18:48:33.268334 13099 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.202.212:60925
Aug 09, 2026 6:48:34 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:48:34 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:48:34 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 6:48:34 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 6:48:34 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 6:48:34 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 18:48:35 dist-test-slave-45dx krb5kdc[30852](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786301315, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.202.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:48:36.087349 13099 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.935s user 0.000s sys 0.304s
I20260809 18:48:36.087479 13099 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 18:48:36.087579 13099 mini_ranger_kms.cc:401] 127.12.202.212:60925/kms/v1/keys
Aug 09 18:48:36 dist-test-slave-45dx krb5kdc[30852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301315, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.202.212@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
Aug 09 18:48:36 dist-test-slave-45dx krb5kdc[30852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301315, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.202.212@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
Aug 09 18:48:38 dist-test-slave-45dx krb5kdc[30852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:48:38.824430 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:34527
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:34527
--ranger_config_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.202.212:60925/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:48:38.911193 31616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:48:38.911402 31616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:48:38.911423 31616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:48:38.912634 31616 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:48:38.912678 31616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:48:38.912691 31616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:48:38.912703 31616 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:48:38.912715 31616 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:48:38.914469 31616 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.202.212:60925/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:34527
--ranger_config_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:34527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:48:38.914755 31616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:48:38.915010 31616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:48:38.921185 31630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:48:38.922706 31616 server_base.cc:1034] running on GCE node
W20260809 18:48:38.921212 31628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:48:38.922794 31633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:48:38.923072 31616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:48:38.923452 31616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:48:38.924626 31616 hybrid_clock.cc:648] HybridClock initialized: now 1786301318924601 us; error 40 us; skew 500 ppm
Aug 09 18:48:38 dist-test-slave-45dx krb5kdc[30852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:48:38.927661 31616 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:48:38.928148 31616 webserver.cc:460] Webserver started at http://127.12.202.254:44827/ using document root <none> and password file <none>
I20260809 18:48:38.928428 31616 fs_manager.cc:359] Metadata directory not provided
I20260809 18:48:38.928491 31616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:48:38.928651 31616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:48:38 dist-test-slave-45dx krb5kdc[30852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
I20260809 18:48:38.982972 31616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "22af83db430c4642a0bbbf03f864e19c"
format_stamp: "Formatted at 2026-08-09 18:48:38 on dist-test-slave-45dx"
server_key: "8e60b391e17e71f8ac3933fcc98cc6e7"
server_key_iv: "e1f24f0860ebe09dcbf700596ae048f1"
server_key_version: "kuduclusterkey@0"
I20260809 18:48:38.983438 31616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "22af83db430c4642a0bbbf03f864e19c"
format_stamp: "Formatted at 2026-08-09 18:48:38 on dist-test-slave-45dx"
server_key: "8e60b391e17e71f8ac3933fcc98cc6e7"
server_key_iv: "e1f24f0860ebe09dcbf700596ae048f1"
server_key_version: "kuduclusterkey@0"
I20260809 18:48:38.985350 31616 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260809 18:48:38.996556 31649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:48:38.996753 31616 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:48:38.996953 31616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "22af83db430c4642a0bbbf03f864e19c"
format_stamp: "Formatted at 2026-08-09 18:48:38 on dist-test-slave-45dx"
server_key: "8e60b391e17e71f8ac3933fcc98cc6e7"
server_key_iv: "e1f24f0860ebe09dcbf700596ae048f1"
server_key_version: "kuduclusterkey@0"
I20260809 18:48:38.997071 31616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:48:39.024132 31616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:48:39.026419 31616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:48:39.026598 31616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:48:39.033540 31616 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:34527
I20260809 18:48:39.033566 31743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:34527 every 8 connection(s)
I20260809 18:48:39.033995 31616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:48:39.034951 31746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:48:39.037984 31746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c: Bootstrap starting.
I20260809 18:48:39.038838 31746 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c: Neither blocks nor log segments found. Creating new log.
I20260809 18:48:39.039448 31746 log.cc:824] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c: Log is configured to *not* fsync() on all Append() calls
I20260809 18:48:39.040349 31746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c: No bootstrap required, opened a new log
I20260809 18:48:39.040362 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 31616
I20260809 18:48:39.040465 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:48:39.040661 13099 external_mini_cluster.cc:1428] Setting key a44a99bbcb545bd2861319d6e3a6eccd
I20260809 18:48:39.044123 31746 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22af83db430c4642a0bbbf03f864e19c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 34527 } }
I20260809 18:48:39.044328 31746 raft_consensus.cc:374] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:48:39.044368 31746 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22af83db430c4642a0bbbf03f864e19c, State: Initialized, Role: FOLLOWER
I20260809 18:48:39.044543 31746 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22af83db430c4642a0bbbf03f864e19c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 34527 } }
I20260809 18:48:39.044622 31746 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:48:39.044649 31746 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:48:39.044710 31746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:48:39.045351 31746 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22af83db430c4642a0bbbf03f864e19c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 34527 } }
I20260809 18:48:39.045478 31746 leader_election.cc:302] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22af83db430c4642a0bbbf03f864e19c; no voters:
I20260809 18:48:39.045675 31746 leader_election.cc:288] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:48:39.045703 31754 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:48:39.046046 31746 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:48:39.046824 31754 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c [term 1 LEADER]: Becoming Leader. State: Replica: 22af83db430c4642a0bbbf03f864e19c, State: Running, Role: LEADER
I20260809 18:48:39.047048 31754 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22af83db430c4642a0bbbf03f864e19c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 34527 } }
I20260809 18:48:39.047425 31754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22af83db430c4642a0bbbf03f864e19c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22af83db430c4642a0bbbf03f864e19c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 34527 } } }
I20260809 18:48:39.047612 31754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c [sys.catalog]: This master's current role is: LEADER
I20260809 18:48:39.047838 31754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22af83db430c4642a0bbbf03f864e19c. Latest consensus state: current_term: 1 leader_uuid: "22af83db430c4642a0bbbf03f864e19c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22af83db430c4642a0bbbf03f864e19c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 34527 } } }
I20260809 18:48:39.047982 31754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c [sys.catalog]: This master's current role is: LEADER
I20260809 18:48:39.048064 31746 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 09 18:48:39 dist-test-slave-45dx krb5kdc[30852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:48:39.052115 31785 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:48:39.053373 31785 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:48:39.056726 31753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:39.041281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40380 (local address 127.12.202.254:34527)
0809 18:48:39.041517 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 18:48:39.041526 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:48:39.041584 (+ 58us) server_negotiation.cc:407] Connection header received
0809 18:48:39.042500 (+ 916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:48:39.042509 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:48:39.042572 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:48:39.042723 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:48:39.043544 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:39.044994 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:39.045961 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:39.046587 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:39.046707 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:39.050875 (+ 4168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:48:39.050967 (+ 92us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:48:39.050967 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:48:39.051113 (+ 146us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:48:39.054382 (+ 3269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:48:39.054829 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:48:39.054833 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:48:39.054833 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:48:39.054951 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:48:39.055180 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:48:39.055181 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:48:39.055181 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:48:39.055641 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:48:39.055843 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 18:48:39.056297 (+ 454us) server_negotiation.cc:299] Negotiation successful
0809 18:48:39.056495 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":121,"threads_started":1}
I20260809 18:48:39.063017 31785 catalog_manager.cc:1347] Generated new cluster ID: 49b0a7109f454723864ff2156a00fd34
I20260809 18:48:39.063088 31785 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:48:39.068213 31785 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:48:39.069016 31785 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:48:39.078027 31785 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c: Generated new TSK 0
I20260809 18:48:39.078246 31785 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
I20260809 18:48:39.767800 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.202.212:60925/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:34527
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:48:39.857959 31818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:48:39.858206 31818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:48:39.858245 31818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:48:39.859465 31818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:48:39.859532 31818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:48:39.859578 31818 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:48:39.861143 31818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.202.212:60925/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:34527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31818
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:48:39.861424 31818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:48:39.861656 31818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:48:39.867211 31818 server_base.cc:1034] running on GCE node
W20260809 18:48:39.867268 31832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:48:39.867405 31829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:48:39.867621 31830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:48:39.867892 31818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:48:39.868137 31818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:48:39.869299 31818 hybrid_clock.cc:648] HybridClock initialized: now 1786301319869270 us; error 47 us; skew 500 ppm
Aug 09 18:48:39 dist-test-slave-45dx krb5kdc[30852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301319, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:48:39.871999 31818 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:48:39.872546 31818 webserver.cc:460] Webserver started at http://127.12.202.193:43673/ using document root <none> and password file <none>
I20260809 18:48:39.872787 31818 fs_manager.cc:359] Metadata directory not provided
I20260809 18:48:39.872833 31818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:48:39.872959 31818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:48:39 dist-test-slave-45dx krb5kdc[30852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301319, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
I20260809 18:48:39.892860 31818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "4cb7121944514c5d8580e8c739f98547"
format_stamp: "Formatted at 2026-08-09 18:48:39 on dist-test-slave-45dx"
server_key: "3efb8a3f918cd63ec7f0102dce8a0ac3"
server_key_iv: "ccb960b198ab0e1e4ccd5a0a9bd081d5"
server_key_version: "kuduclusterkey@0"
I20260809 18:48:39.893316 31818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "4cb7121944514c5d8580e8c739f98547"
format_stamp: "Formatted at 2026-08-09 18:48:39 on dist-test-slave-45dx"
server_key: "3efb8a3f918cd63ec7f0102dce8a0ac3"
server_key_iv: "ccb960b198ab0e1e4ccd5a0a9bd081d5"
server_key_version: "kuduclusterkey@0"
I20260809 18:48:39.895164 31818 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 18:48:39.909910 31846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:48:39.910176 31818 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:48:39.910298 31818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "4cb7121944514c5d8580e8c739f98547"
format_stamp: "Formatted at 2026-08-09 18:48:39 on dist-test-slave-45dx"
server_key: "3efb8a3f918cd63ec7f0102dce8a0ac3"
server_key_iv: "ccb960b198ab0e1e4ccd5a0a9bd081d5"
server_key_version: "kuduclusterkey@0"
I20260809 18:48:39.910416 31818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:48:39.950188 31818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:48:39.952827 31818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:48:39.953050 31818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:48:39.953366 31818 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:48:39.953809 31818 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:48:39.953904 31818 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:48:39.954007 31818 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:48:39.954099 31818 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:48:39.962193 31818 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:37897
I20260809 18:48:39.963093 31818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:48:39.964076 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 31818
I20260809 18:48:39.964200 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:48:39.964439 13099 external_mini_cluster.cc:1428] Setting key 14d1a015bba6fc14edda3a07e4a020e9
I20260809 18:48:39.966547 32026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:37897 every 8 connection(s)
Aug 09 18:48:39 dist-test-slave-45dx krb5kdc[30852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301319, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:48:39.980046 32033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:39.967141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:34527 (local address 127.12.202.193:41955)
0809 18:48:39.967667 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0809 18:48:39.967717 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 18:48:39.968389 (+ 672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:48:39.970452 (+ 2063us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:48:39.970455 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:48:39.970656 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:48:39.970861 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:48:39.970866 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:48:39.971600 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:48:39.971601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:48:39.972960 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:48:39.972963 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:48:39.973553 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:48:39.973554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:48:39.973711 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:39.974441 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:48:39.974461 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:48:39.975820 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:48:39.978094 (+ 2274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:48:39.978101 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:48:39.978104 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:48:39.978494 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:48:39.978734 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:48:39.978735 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:48:39.978735 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:48:39.978897 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:48:39.979249 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:48:39.979255 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:48:39.979500 (+ 245us) client_negotiation.cc:769] Sending connection context
0809 18:48:39.979622 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 18:48:39.979804 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":89,"threads_started":1}
I20260809 18:48:39.980643 32032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:39.967144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:41955 (local address 127.12.202.254:34527)
0809 18:48:39.970192 (+ 3048us) server_negotiation.cc:206] Beginning negotiation
0809 18:48:39.970194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:48:39.970202 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:48:39.970226 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:48:39.970226 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:48:39.970236 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:48:39.970342 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:48:39.970980 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:39.971500 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:39.973061 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:39.973405 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:39.973476 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:39.975924 (+ 2448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:48:39.975925 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:48:39.975926 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:48:39.975934 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:48:39.977992 (+ 2058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:48:39.978583 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:48:39.978584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:48:39.978585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:48:39.978658 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:48:39.978974 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:48:39.978975 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:48:39.978975 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:48:39.979153 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:48:39.979220 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 18:48:39.980456 (+ 1236us) server_negotiation.cc:299] Negotiation successful
0809 18:48:39.980549 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3017,"thread_start_us":94,"threads_started":1}
I20260809 18:48:39.981417 32027 heartbeater.cc:347] Connected to a master server at 127.12.202.254:34527
I20260809 18:48:39.981519 32027 heartbeater.cc:464] Registering TS with master...
I20260809 18:48:39.981714 32027 heartbeater.cc:511] Master 127.12.202.254:34527 requested a full tablet report, sending...
I20260809 18:48:39.982353 31674 ts_manager.cc:194] Registered new tserver with Master: 4cb7121944514c5d8580e8c739f98547 (127.12.202.193:37897)
I20260809 18:48:39.983224 31674 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:41955
WARNING: no policy specified for kudu/127.12.202.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
I20260809 18:48:40.009078 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.202.212:60925/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:34527
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:48:40.134295 32037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:48:40.134654 32037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:48:40.134738 32037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:48:40.136583 32037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:48:40.136811 32037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:48:40.136906 32037 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:48:40.139145 32037 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.202.212:60925/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:34527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32037
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:48:40.139643 32037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:48:40.139968 32037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:48:40.147611 32057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:48:40.149713 32037 server_base.cc:1034] running on GCE node
W20260809 18:48:40.152472 32056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:48:40.152783 32060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:48:40.153100 32037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:48:40.153414 32037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:48:40.154599 32037 hybrid_clock.cc:648] HybridClock initialized: now 1786301320154587 us; error 46 us; skew 500 ppm
Aug 09 18:48:40 dist-test-slave-45dx krb5kdc[30852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301320, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 09 18:48:40 dist-test-slave-45dx krb5kdc[30852](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786301320, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:48:40.158473 32037 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:48:40.158999 32037 webserver.cc:460] Webserver started at http://127.12.202.194:42245/ using document root <none> and password file <none>
I20260809 18:48:40.159283 32037 fs_manager.cc:359] Metadata directory not provided
I20260809 18:48:40.159358 32037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:48:40.159497 32037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:48:40 dist-test-slave-45dx krb5kdc[30852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301320, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
I20260809 18:48:40.178514 32037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "383b34984b314bbaac816e2dd460347f"
format_stamp: "Formatted at 2026-08-09 18:48:40 on dist-test-slave-45dx"
server_key: "41d3e2256cd4563a55717775d4f5bdf8"
server_key_iv: "2efd3fa3fe608a2bf5c2bbd217c6e527"
server_key_version: "kuduclusterkey@0"
I20260809 18:48:40.179220 32037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "383b34984b314bbaac816e2dd460347f"
format_stamp: "Formatted at 2026-08-09 18:48:40 on dist-test-slave-45dx"
server_key: "41d3e2256cd4563a55717775d4f5bdf8"
server_key_iv: "2efd3fa3fe608a2bf5c2bbd217c6e527"
server_key_version: "kuduclusterkey@0"
I20260809 18:48:40.183761 32037 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.002s
I20260809 18:48:40.210845 32070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:48:40.211124 32037 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 18:48:40.211222 32037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "383b34984b314bbaac816e2dd460347f"
format_stamp: "Formatted at 2026-08-09 18:48:40 on dist-test-slave-45dx"
server_key: "41d3e2256cd4563a55717775d4f5bdf8"
server_key_iv: "2efd3fa3fe608a2bf5c2bbd217c6e527"
server_key_version: "kuduclusterkey@0"
I20260809 18:48:40.211339 32037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:48:40.231947 32037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:48:40.234349 32037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:48:40.234529 32037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:48:40.234879 32037 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:48:40.235287 32037 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:48:40.235347 32037 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:48:40.235409 32037 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:48:40.235438 32037 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:48:40.244946 32037 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:43621
I20260809 18:48:40.244989 32267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:43621 every 8 connection(s)
I20260809 18:48:40.245441 32037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:48:40.247399 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 32037
I20260809 18:48:40.247552 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:48:40.247740 13099 external_mini_cluster.cc:1428] Setting key 6bf9c80f46fe7c107f5b5d5ffedf97d2
WARNING: no policy specified for kudu/127.12.202.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.195@KRBTEST.COM" created.
Aug 09 18:48:40 dist-test-slave-45dx krb5kdc[30852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301320, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:48:40.282143 32270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.246881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:34527 (local address 127.12.202.194:55723)
0809 18:48:40.251690 (+ 4809us) negotiation.cc:107] Waiting for socket to connect
0809 18:48:40.251744 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 18:48:40.252389 (+ 645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:48:40.255783 (+ 3394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:48:40.255787 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:48:40.256019 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:48:40.256274 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:48:40.256280 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.257279 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.257280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:48:40.258473 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:48:40.258477 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.259040 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.259041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:48:40.259219 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:40.260010 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:48:40.260022 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:48:40.277833 (+ 17811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:48:40.280190 (+ 2357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:48:40.280199 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:48:40.280202 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:48:40.280626 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:48:40.280867 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:48:40.280868 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:48:40.280869 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:48:40.281037 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:48:40.281379 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:48:40.281387 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:48:40.281572 (+ 185us) client_negotiation.cc:769] Sending connection context
0809 18:48:40.281679 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 18:48:40.281888 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4760,"thread_start_us":86,"threads_started":1}
I20260809 18:48:40.282872 32032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.246886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:55723 (local address 127.12.202.254:34527)
0809 18:48:40.246961 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 18:48:40.246963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:48:40.251862 (+ 4899us) server_negotiation.cc:407] Connection header received
0809 18:48:40.252506 (+ 644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:48:40.252508 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:48:40.252540 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:48:40.252594 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:48:40.256413 (+ 3819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.257126 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.258566 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.258952 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.259032 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:40.277967 (+ 18935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:48:40.277970 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:48:40.277970 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:48:40.277981 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:48:40.280059 (+ 2078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:48:40.280724 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:48:40.280725 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:48:40.280726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:48:40.280791 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:48:40.281123 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:48:40.281124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:48:40.281124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:48:40.281272 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:48:40.281347 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 18:48:40.282688 (+ 1341us) server_negotiation.cc:299] Negotiation successful
0809 18:48:40.282780 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 18:48:40.283452 32268 heartbeater.cc:347] Connected to a master server at 127.12.202.254:34527
I20260809 18:48:40.283555 32268 heartbeater.cc:464] Registering TS with master...
I20260809 18:48:40.283751 32268 heartbeater.cc:511] Master 127.12.202.254:34527 requested a full tablet report, sending...
I20260809 18:48:40.284173 31674 ts_manager.cc:194] Registered new tserver with Master: 383b34984b314bbaac816e2dd460347f (127.12.202.194:43621)
I20260809 18:48:40.284758 31674 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:55723
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
I20260809 18:48:40.299842 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.202.212:60925/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:34527
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:48:40.419051 32276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:48:40.419401 32276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:48:40.419483 32276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:48:40.421316 32276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:48:40.421523 32276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:48:40.421610 32276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:48:40.423789 32276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.202.212:60925/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:34527
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:48:40.424211 32276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:48:40.424535 32276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:48:40.431208 32286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:48:40.431222 32284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:48:40.431613 32288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:48:40.432611 32276 server_base.cc:1034] running on GCE node
I20260809 18:48:40.432900 32276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:48:40.433146 32276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:48:40.434316 32276 hybrid_clock.cc:648] HybridClock initialized: now 1786301320434293 us; error 34 us; skew 500 ppm
Aug 09 18:48:40 dist-test-slave-45dx krb5kdc[30852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301320, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:48:40.437557 32276 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:48:40.438045 32276 webserver.cc:460] Webserver started at http://127.12.202.195:44163/ using document root <none> and password file <none>
I20260809 18:48:40.438282 32276 fs_manager.cc:359] Metadata directory not provided
I20260809 18:48:40.438329 32276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:48:40.438442 32276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:48:40 dist-test-slave-45dx krb5kdc[30852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301320, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
I20260809 18:48:40.454361 32276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "c0dfbc34815248c79d480eaa1a999f8b"
format_stamp: "Formatted at 2026-08-09 18:48:40 on dist-test-slave-45dx"
server_key: "f19cc70efec98e5c8a3777eb6a6973dc"
server_key_iv: "beb6855cd2e6df8c6ba14761acf07f77"
server_key_version: "kuduclusterkey@0"
I20260809 18:48:40.454823 32276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "c0dfbc34815248c79d480eaa1a999f8b"
format_stamp: "Formatted at 2026-08-09 18:48:40 on dist-test-slave-45dx"
server_key: "f19cc70efec98e5c8a3777eb6a6973dc"
server_key_iv: "beb6855cd2e6df8c6ba14761acf07f77"
server_key_version: "kuduclusterkey@0"
I20260809 18:48:40.463639 32276 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.003s sys 0.000s
I20260809 18:48:40.477464 32301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:48:40.477813 32276 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:48:40.477954 32276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "c0dfbc34815248c79d480eaa1a999f8b"
format_stamp: "Formatted at 2026-08-09 18:48:40 on dist-test-slave-45dx"
server_key: "f19cc70efec98e5c8a3777eb6a6973dc"
server_key_iv: "beb6855cd2e6df8c6ba14761acf07f77"
server_key_version: "kuduclusterkey@0"
I20260809 18:48:40.478091 32276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:48:40.504396 32276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:48:40.507041 32276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:48:40.507261 32276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:48:40.507572 32276 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:48:40.507998 32276 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:48:40.508051 32276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:48:40.508085 32276 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:48:40.508104 32276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:48:40.521338 32276 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:46635
I20260809 18:48:40.521996 32501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:46635 every 8 connection(s)
I20260809 18:48:40.522277 32276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:48:40 dist-test-slave-45dx krb5kdc[30852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301320, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:48:40.530731 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 32276
I20260809 18:48:40.530834 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:48:40.531033 13099 external_mini_cluster.cc:1428] Setting key dbb6ed24d4e3a476a01d5dc1404359f6
I20260809 18:48:40.533978 32032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.523385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:57263 (local address 127.12.202.254:34527)
0809 18:48:40.523432 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 18:48:40.523434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:48:40.523815 (+ 381us) server_negotiation.cc:407] Connection header received
0809 18:48:40.524490 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:48:40.524492 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:48:40.524505 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:48:40.524584 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:48:40.525317 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.526085 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.527575 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.527872 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.527953 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:40.530630 (+ 2677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:48:40.530631 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:48:40.530632 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:48:40.530639 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:48:40.532362 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:48:40.532851 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:48:40.532852 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:48:40.532853 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:48:40.532918 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:48:40.533206 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:48:40.533208 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:48:40.533208 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:48:40.533366 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:48:40.533446 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 18:48:40.533790 (+ 344us) server_negotiation.cc:299] Negotiation successful
0809 18:48:40.533882 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:48:40.534190 32508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.523384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:34527 (local address 127.12.202.195:57263)
0809 18:48:40.523638 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 18:48:40.523685 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 18:48:40.524373 (+ 688us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:48:40.524659 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:48:40.524663 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:48:40.524918 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:48:40.525193 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:48:40.525199 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.526196 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.526196 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:48:40.527453 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:48:40.527456 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.528028 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.528029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:48:40.528179 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:40.528826 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:48:40.528836 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:48:40.530524 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:48:40.532457 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:48:40.532463 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:48:40.532465 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:48:40.532756 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:48:40.532993 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:48:40.532994 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:48:40.532994 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:48:40.533123 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:48:40.533457 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:48:40.533464 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:48:40.533622 (+ 158us) client_negotiation.cc:769] Sending connection context
0809 18:48:40.533746 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 18:48:40.533902 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":157,"threads_started":1}
I20260809 18:48:40.534837 32503 heartbeater.cc:347] Connected to a master server at 127.12.202.254:34527
I20260809 18:48:40.534942 32503 heartbeater.cc:464] Registering TS with master...
I20260809 18:48:40.535135 32503 heartbeater.cc:511] Master 127.12.202.254:34527 requested a full tablet report, sending...
I20260809 18:48:40.535583 31674 ts_manager.cc:194] Registered new tserver with Master: c0dfbc34815248c79d480eaa1a999f8b (127.12.202.195:46635)
I20260809 18:48:40.536055 31674 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:57263
I20260809 18:48:40.542670 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:48:40.553644 32032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.545720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40386 (local address 127.12.202.254:34527)
0809 18:48:40.545763 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 18:48:40.545764 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:48:40.545969 (+ 205us) server_negotiation.cc:407] Connection header received
0809 18:48:40.546019 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:48:40.546020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:48:40.546032 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:48:40.546092 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:48:40.546850 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.547547 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.548767 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.549045 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.549118 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:40.550611 (+ 1493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:48:40.550613 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:48:40.550613 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:48:40.550620 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:48:40.552403 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:48:40.552787 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:48:40.552788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:48:40.552789 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:48:40.552852 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:48:40.553085 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:48:40.553086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:48:40.553086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:48:40.553214 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:48:40.553316 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 18:48:40.553474 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 18:48:40.553554 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:48:40.555513 31674 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40386:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:48:40.557870 31674 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:48:40.568468 32526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.562597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:46635 (local address 127.0.0.1:34808)
0809 18:48:40.563382 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0809 18:48:40.563422 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 18:48:40.563490 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:48:40.563807 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:48:40.563810 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:48:40.563812 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:48:40.563895 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:48:40.563897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.565167 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.565168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:48:40.566719 (+ 1551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:48:40.566723 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.568132 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.568133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:48:40.568212 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:40.568226 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 18:48:40.568295 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 18:48:40.568394 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":755,"thread_start_us":76,"threads_started":1}
I20260809 18:48:40.568915 32529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.563116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34808 (local address 127.12.202.195:46635)
0809 18:48:40.563627 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0809 18:48:40.563632 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:48:40.563641 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:48:40.563678 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:48:40.563680 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:48:40.563695 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:48:40.563777 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:48:40.563991 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.565066 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.566850 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.567953 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.568039 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:40.568096 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 18:48:40.568753 (+ 657us) server_negotiation.cc:299] Negotiation successful
0809 18:48:40.568834 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":140,"threads_started":1}
I20260809 18:48:40.568562 32524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.562809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:37897 (local address 127.0.0.1:51710)
0809 18:48:40.564402 (+ 1593us) negotiation.cc:107] Waiting for socket to connect
0809 18:48:40.564412 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:48:40.564463 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:48:40.564744 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:48:40.564745 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:48:40.564747 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:48:40.564785 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:48:40.564787 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.565983 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.565984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:48:40.567075 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:48:40.567077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.568265 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.568266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:48:40.568388 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:40.568395 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 18:48:40.568448 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 18:48:40.568487 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1575,"thread_start_us":139,"threads_started":1}
I20260809 18:48:40.569983 32365 tablet_service.cc:1467] Processing CreateTablet for tablet 136a366f97d849ef93795be87f2f32dd (DEFAULT_TABLE table=test-table [id=68784c1063604339ae25ad7996dbc4e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:48:40.570422 32365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 136a366f97d849ef93795be87f2f32dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:48:40.570472 32531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.563165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51710 (local address 127.12.202.193:37897)
0809 18:48:40.564563 (+ 1398us) server_negotiation.cc:206] Beginning negotiation
0809 18:48:40.564567 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:48:40.564576 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:48:40.564606 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:48:40.564608 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:48:40.564623 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:48:40.564685 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:48:40.564851 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.565894 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.567412 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.568117 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.568184 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:40.568231 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 18:48:40.570359 (+ 2128us) server_negotiation.cc:299] Negotiation successful
0809 18:48:40.570402 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1366,"thread_start_us":107,"threads_started":1}
I20260809 18:48:40.571028 31933 tablet_service.cc:1467] Processing CreateTablet for tablet 136a366f97d849ef93795be87f2f32dd (DEFAULT_TABLE table=test-table [id=68784c1063604339ae25ad7996dbc4e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:48:40.571341 31933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 136a366f97d849ef93795be87f2f32dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:48:40.574926 32539 tablet_bootstrap.cc:492] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547: Bootstrap starting.
I20260809 18:48:40.575670 32539 tablet_bootstrap.cc:654] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547: Neither blocks nor log segments found. Creating new log.
I20260809 18:48:40.576032 32539 log.cc:824] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547: Log is configured to *not* fsync() on all Append() calls
I20260809 18:48:40.577006 32539 tablet_bootstrap.cc:492] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547: No bootstrap required, opened a new log
I20260809 18:48:40.577073 32539 ts_tablet_manager.cc:1397] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:48:40.577201 32523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.562601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:43621 (local address 127.0.0.1:40184)
0809 18:48:40.563888 (+ 1287us) negotiation.cc:107] Waiting for socket to connect
0809 18:48:40.563898 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:48:40.563944 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:48:40.568650 (+ 4706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:48:40.568651 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:48:40.568653 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:48:40.568686 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:48:40.568687 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.574854 (+ 6167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.574855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:48:40.575885 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:48:40.575889 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.576978 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.576979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:48:40.577042 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:40.577046 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:48:40.577092 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 18:48:40.577132 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1269,"thread_start_us":177,"threads_started":1}
I20260809 18:48:40.577526 32528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.562939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40184 (local address 127.12.202.194:43621)
0809 18:48:40.567232 (+ 4293us) server_negotiation.cc:206] Beginning negotiation
0809 18:48:40.567236 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:48:40.567245 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:48:40.567290 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:48:40.567292 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:48:40.567306 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:48:40.568759 (+ 1453us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:48:40.568834 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.570255 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.576021 (+ 5766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.576800 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.576894 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:40.576942 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 18:48:40.577402 (+ 460us) server_negotiation.cc:299] Negotiation successful
0809 18:48:40.577445 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4253,"thread_start_us":88,"threads_started":1}
I20260809 18:48:40.578218 32147 tablet_service.cc:1467] Processing CreateTablet for tablet 136a366f97d849ef93795be87f2f32dd (DEFAULT_TABLE table=test-table [id=68784c1063604339ae25ad7996dbc4e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:48:40.578588 32147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 136a366f97d849ef93795be87f2f32dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:48:40.579586 32539 raft_consensus.cc:348] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0dfbc34815248c79d480eaa1a999f8b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46635 } } peers { permanent_uuid: "4cb7121944514c5d8580e8c739f98547" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37897 } } peers { permanent_uuid: "383b34984b314bbaac816e2dd460347f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43621 } }
I20260809 18:48:40.579748 32539 raft_consensus.cc:374] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:48:40.579783 32539 raft_consensus.cc:729] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cb7121944514c5d8580e8c739f98547, State: Initialized, Role: FOLLOWER
I20260809 18:48:40.580243 32539 consensus_queue.cc:260] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0dfbc34815248c79d480eaa1a999f8b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46635 } } peers { permanent_uuid: "4cb7121944514c5d8580e8c739f98547" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37897 } } peers { permanent_uuid: "383b34984b314bbaac816e2dd460347f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43621 } }
I20260809 18:48:40.580628 32539 ts_tablet_manager.cc:1428] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260809 18:48:40.580788 32027 heartbeater.cc:503] Master 127.12.202.254:34527 was elected leader, sending a full tablet report...
I20260809 18:48:40.584466 32537 tablet_bootstrap.cc:492] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b: Bootstrap starting.
I20260809 18:48:40.584496 32543 tablet_bootstrap.cc:492] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f: Bootstrap starting.
I20260809 18:48:40.585568 32537 tablet_bootstrap.cc:654] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b: Neither blocks nor log segments found. Creating new log.
I20260809 18:48:40.585572 32543 tablet_bootstrap.cc:654] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f: Neither blocks nor log segments found. Creating new log.
I20260809 18:48:40.585902 32543 log.cc:824] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f: Log is configured to *not* fsync() on all Append() calls
I20260809 18:48:40.585974 32537 log.cc:824] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b: Log is configured to *not* fsync() on all Append() calls
I20260809 18:48:40.586776 32543 tablet_bootstrap.cc:492] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f: No bootstrap required, opened a new log
I20260809 18:48:40.586844 32543 ts_tablet_manager.cc:1397] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:48:40.588973 32543 raft_consensus.cc:348] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0dfbc34815248c79d480eaa1a999f8b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46635 } } peers { permanent_uuid: "4cb7121944514c5d8580e8c739f98547" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37897 } } peers { permanent_uuid: "383b34984b314bbaac816e2dd460347f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43621 } }
I20260809 18:48:40.589147 32543 raft_consensus.cc:374] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:48:40.589186 32543 raft_consensus.cc:729] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 383b34984b314bbaac816e2dd460347f, State: Initialized, Role: FOLLOWER
I20260809 18:48:40.589313 32543 consensus_queue.cc:260] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0dfbc34815248c79d480eaa1a999f8b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46635 } } peers { permanent_uuid: "4cb7121944514c5d8580e8c739f98547" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37897 } } peers { permanent_uuid: "383b34984b314bbaac816e2dd460347f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43621 } }
I20260809 18:48:40.589589 32543 ts_tablet_manager.cc:1428] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:48:40.589651 32268 heartbeater.cc:503] Master 127.12.202.254:34527 was elected leader, sending a full tablet report...
I20260809 18:48:40.590294 32537 tablet_bootstrap.cc:492] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b: No bootstrap required, opened a new log
I20260809 18:48:40.590363 32537 ts_tablet_manager.cc:1397] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260809 18:48:40.591794 32537 raft_consensus.cc:348] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0dfbc34815248c79d480eaa1a999f8b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46635 } } peers { permanent_uuid: "4cb7121944514c5d8580e8c739f98547" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37897 } } peers { permanent_uuid: "383b34984b314bbaac816e2dd460347f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43621 } }
I20260809 18:48:40.591899 32537 raft_consensus.cc:374] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:48:40.591918 32537 raft_consensus.cc:729] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0dfbc34815248c79d480eaa1a999f8b, State: Initialized, Role: FOLLOWER
I20260809 18:48:40.592027 32537 consensus_queue.cc:260] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0dfbc34815248c79d480eaa1a999f8b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46635 } } peers { permanent_uuid: "4cb7121944514c5d8580e8c739f98547" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37897 } } peers { permanent_uuid: "383b34984b314bbaac816e2dd460347f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43621 } }
I20260809 18:48:40.592279 32537 ts_tablet_manager.cc:1428] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:48:40.592541 32503 heartbeater.cc:503] Master 127.12.202.254:34527 was elected leader, sending a full tablet report...
Aug 09 18:48:40 dist-test-slave-45dx krb5kdc[30852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301320, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
W20260809 18:48:40.718068 32028 tablet.cc:2369] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:48:40.746394 32269 tablet.cc:2369] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:48:40.773361 32505 tablet.cc:2369] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:48:40.773741 32542 raft_consensus.cc:482] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:48:40.773893 32542 raft_consensus.cc:504] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0dfbc34815248c79d480eaa1a999f8b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46635 } } peers { permanent_uuid: "4cb7121944514c5d8580e8c739f98547" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37897 } } peers { permanent_uuid: "383b34984b314bbaac816e2dd460347f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43621 } }
I20260809 18:48:40.774307 32542 leader_election.cc:288] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0dfbc34815248c79d480eaa1a999f8b (127.12.202.195:46635), 383b34984b314bbaac816e2dd460347f (127.12.202.194:43621)
I20260809 18:48:40.778702 32528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.774854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:52777 (local address 127.12.202.194:43621)
0809 18:48:40.774946 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0809 18:48:40.774948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:48:40.774985 (+ 37us) server_negotiation.cc:407] Connection header received
0809 18:48:40.775100 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:48:40.775101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:48:40.775113 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:48:40.775145 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:48:40.775399 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.776164 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.777738 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.778297 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.778348 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:40.778357 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:48:40.778592 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 18:48:40.778631 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 18:48:40.778717 32529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.774799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:58001 (local address 127.12.202.195:46635)
0809 18:48:40.774907 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 18:48:40.774909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:48:40.775092 (+ 183us) server_negotiation.cc:407] Connection header received
0809 18:48:40.775183 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:48:40.775184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:48:40.775194 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:48:40.775223 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:48:40.775444 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.776136 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.777762 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.778301 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.778359 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:40.778367 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 18:48:40.778592 (+ 225us) server_negotiation.cc:299] Negotiation successful
0809 18:48:40.778631 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 18:48:40.779107 32551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.774476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:43621 (local address 127.12.202.193:52777)
0809 18:48:40.774912 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 18:48:40.774924 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:48:40.775015 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:48:40.775222 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:48:40.775222 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:48:40.775224 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:48:40.775316 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:48:40.775318 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.776332 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.776332 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:48:40.777622 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:48:40.777626 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.778424 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.778425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:48:40.778503 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:40.778506 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:48:40.778953 (+ 447us) client_negotiation.cc:240] Negotiation successful
0809 18:48:40.779001 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":233,"threads_started":1}
I20260809 18:48:40.779107 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.774477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:46635 (local address 127.12.202.193:58001)
0809 18:48:40.775037 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0809 18:48:40.775046 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:48:40.775114 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:48:40.775283 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:48:40.775283 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:48:40.775285 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:48:40.775365 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:48:40.775367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.776331 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.776332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:48:40.777665 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:48:40.777667 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.778426 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.778427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:48:40.778508 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:40.778511 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:48:40.778994 (+ 483us) client_negotiation.cc:240] Negotiation successful
0809 18:48:40.779023 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"mutex_wait_us":212,"thread_start_us":161,"threads_started":1}
I20260809 18:48:40.779575 32184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "136a366f97d849ef93795be87f2f32dd" candidate_uuid: "4cb7121944514c5d8580e8c739f98547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "383b34984b314bbaac816e2dd460347f" is_pre_election: true
I20260809 18:48:40.779793 32184 raft_consensus.cc:2454] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cb7121944514c5d8580e8c739f98547 in term 0.
I20260809 18:48:40.779785 32427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "136a366f97d849ef93795be87f2f32dd" candidate_uuid: "4cb7121944514c5d8580e8c739f98547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0dfbc34815248c79d480eaa1a999f8b" is_pre_election: true
I20260809 18:48:40.779912 32427 raft_consensus.cc:2454] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cb7121944514c5d8580e8c739f98547 in term 0.
I20260809 18:48:40.780057 31850 leader_election.cc:302] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 383b34984b314bbaac816e2dd460347f, 4cb7121944514c5d8580e8c739f98547; no voters:
I20260809 18:48:40.780220 32542 raft_consensus.cc:2781] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:48:40.780318 32542 raft_consensus.cc:482] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:48:40.780344 32542 raft_consensus.cc:3037] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:48:40.781311 32542 raft_consensus.cc:504] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0dfbc34815248c79d480eaa1a999f8b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46635 } } peers { permanent_uuid: "4cb7121944514c5d8580e8c739f98547" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37897 } } peers { permanent_uuid: "383b34984b314bbaac816e2dd460347f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43621 } }
I20260809 18:48:40.781451 32542 leader_election.cc:288] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [CANDIDATE]: Term 1 election: Requested vote from peers c0dfbc34815248c79d480eaa1a999f8b (127.12.202.195:46635), 383b34984b314bbaac816e2dd460347f (127.12.202.194:43621)
I20260809 18:48:40.781630 32427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "136a366f97d849ef93795be87f2f32dd" candidate_uuid: "4cb7121944514c5d8580e8c739f98547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0dfbc34815248c79d480eaa1a999f8b"
I20260809 18:48:40.781714 32427 raft_consensus.cc:3037] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:48:40.781860 32184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "136a366f97d849ef93795be87f2f32dd" candidate_uuid: "4cb7121944514c5d8580e8c739f98547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "383b34984b314bbaac816e2dd460347f"
I20260809 18:48:40.781947 32184 raft_consensus.cc:3037] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:48:40.782617 32427 raft_consensus.cc:2454] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cb7121944514c5d8580e8c739f98547 in term 1.
I20260809 18:48:40.782804 31851 leader_election.cc:302] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cb7121944514c5d8580e8c739f98547, c0dfbc34815248c79d480eaa1a999f8b; no voters:
I20260809 18:48:40.782970 32184 raft_consensus.cc:2454] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cb7121944514c5d8580e8c739f98547 in term 1.
I20260809 18:48:40.783172 32542 raft_consensus.cc:2781] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:48:40.783351 32542 raft_consensus.cc:686] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [term 1 LEADER]: Becoming Leader. State: Replica: 4cb7121944514c5d8580e8c739f98547, State: Running, Role: LEADER
I20260809 18:48:40.783456 32542 consensus_queue.cc:237] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0dfbc34815248c79d480eaa1a999f8b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46635 } } peers { permanent_uuid: "4cb7121944514c5d8580e8c739f98547" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37897 } } peers { permanent_uuid: "383b34984b314bbaac816e2dd460347f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43621 } }
I20260809 18:48:40.784392 31674 catalog_manager.cc:5495] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cb7121944514c5d8580e8c739f98547 (127.12.202.193). New cstate: current_term: 1 leader_uuid: "4cb7121944514c5d8580e8c739f98547" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0dfbc34815248c79d480eaa1a999f8b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cb7121944514c5d8580e8c739f98547" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "383b34984b314bbaac816e2dd460347f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43621 } health_report { overall_health: UNKNOWN } } }
I20260809 18:48:40.802338 32531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.798622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51724 (local address 127.12.202.193:37897)
0809 18:48:40.798687 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:48:40.798689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:48:40.798707 (+ 18us) server_negotiation.cc:407] Connection header received
0809 18:48:40.798753 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:48:40.798754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:48:40.798774 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:48:40.798867 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:48:40.799083 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.799846 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.801182 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:48:40.801474 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:48:40.801537 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:48:40.801749 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:48:40.801890 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:48:40.801972 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 18:48:40.802209 (+ 237us) server_negotiation.cc:299] Negotiation successful
0809 18:48:40.802234 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 18:48:40.804719 32184 raft_consensus.cc:1261] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f [term 1 FOLLOWER]: Refusing update from remote peer 4cb7121944514c5d8580e8c739f98547: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:48:40.805048 32427 raft_consensus.cc:1261] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b [term 1 FOLLOWER]: Refusing update from remote peer 4cb7121944514c5d8580e8c739f98547: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:48:40.805375 32542 consensus_queue.cc:1035] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0dfbc34815248c79d480eaa1a999f8b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:48:40.805913 32542 consensus_queue.cc:1035] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [LEADER]: Connected to new peer: Peer: permanent_uuid: "383b34984b314bbaac816e2dd460347f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:48:40.813428 31674 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40386:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:48:40.813536 31674 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40386:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:48:40.814424 31674 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 22af83db430c4642a0bbbf03f864e19c: Sending DeleteTablet for 3 replicas of tablet 136a366f97d849ef93795be87f2f32dd
I20260809 18:48:40.814707 32147 tablet_service.cc:1514] Processing DeleteTablet for tablet 136a366f97d849ef93795be87f2f32dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:48:40 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:40184
I20260809 18:48:40.814823 32365 tablet_service.cc:1514] Processing DeleteTablet for tablet 136a366f97d849ef93795be87f2f32dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:48:40 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:34808
I20260809 18:48:40.815073 32577 tablet_replica.cc:330] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b: stopping tablet replica
I20260809 18:48:40.815176 32577 raft_consensus.cc:2229] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:48:40.815238 32577 pending_rounds.cc:62] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b: Trying to abort 2 pending ops.
I20260809 18:48:40.815271 32577 pending_rounds.cc:68] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7316690210012545024 op_type: WRITE_OP write_request { tablet_id: "136a366f97d849ef93795be87f2f32dd" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\264\231\343\323\006\"8\n\ntest-admin\022*\n 68784c1063604339ae25ad7996dbc4e6\020\001\030\001 \001(\001" signature: "<redacted>""\205{\003y|\343Q\010\340x\370\354T\203\313\025\251pg\275\2317U\242&\344\2134\324\231\177\275J\344\024q\007\370k&\330\260J\000\233<`\022\215\030\002/\205s\370\003\330SA\270\221\000=\312" signing_key_seq_num: 0 } } request_id { client_id: "e6826d60c51b458bae2050f3392257e1" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260809 18:48:40.815376 31933 tablet_service.cc:1514] Processing DeleteTablet for tablet 136a366f97d849ef93795be87f2f32dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:48:40 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:51710
I20260809 18:48:40.815558 31932 tablet_service.cc:1514] Processing DeleteTablet for tablet 136a366f97d849ef93795be87f2f32dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:48:40 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:51710
I20260809 18:48:40.815526 32577 pending_rounds.cc:68] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316690209929605120 op_type: NO_OP noop_request { }
I20260809 18:48:40.815685 32577 raft_consensus.cc:2866] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260809 18:48:40.815718 32577 raft_consensus.cc:2258] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:48:40.816146 32577 ts_tablet_manager.cc:1905] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 18:48:40.816382 31851 consensus_peers.cc:487] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 -> Peer c0dfbc34815248c79d480eaa1a999f8b (127.12.202.195:46635): Couldn't send request to peer c0dfbc34815248c79d480eaa1a999f8b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260809 18:48:40.816536 32568 mvcc.cc:205] Tried to move back new op lower bound from 7316690210012545024 to 7316690209929605120. Current Snapshot: MvccSnapshot[applied={T|T < 7316690210012545024}]
I20260809 18:48:40.817344 32576 tablet_replica.cc:330] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f: stopping tablet replica
I20260809 18:48:40.817500 32576 raft_consensus.cc:2229] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:48:40.817651 32576 raft_consensus.cc:2258] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:48:40.817930 32577 ts_tablet_manager.cc:1918] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:48:40.818013 32577 log.cc:1196] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/136a366f97d849ef93795be87f2f32dd
I20260809 18:48:40.818298 32576 ts_tablet_manager.cc:1905] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:48:40.818646 32577 ts_tablet_manager.cc:1939] T 136a366f97d849ef93795be87f2f32dd P c0dfbc34815248c79d480eaa1a999f8b: Deleting consensus metadata
I20260809 18:48:40.819098 31654 catalog_manager.cc:4841] TS c0dfbc34815248c79d480eaa1a999f8b (127.12.202.195:46635): tablet 136a366f97d849ef93795be87f2f32dd (table test-table [id=68784c1063604339ae25ad7996dbc4e6]) successfully deleted
I20260809 18:48:40.820400 32578 tablet_replica.cc:330] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547: stopping tablet replica
I20260809 18:48:40.820511 32578 raft_consensus.cc:2229] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:48:40.820649 32578 raft_consensus.cc:2258] T 136a366f97d849ef93795be87f2f32dd P 4cb7121944514c5d8580e8c739f98547 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:48:40.820749 32576 ts_tablet_manager.cc:1918] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:48:40.820881 32576 log.cc:1196] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/136a366f97d849ef93795be87f2f32dd
I20260809 18:48:40.821262 32576 ts_tablet_manager.cc:1939] T 136a366f97d849ef93795be87f2f32dd P 383b34984b314bbaac816e2dd460347f: Deleting consensus metadata
I20260809 18:48:40.821815 31653 catalog_manager.cc:4841] TS 383b34984b314bbaac816e2dd460347f (127.12.202.194:43621): tablet 136a366f97d849ef93795be87f2f32dd (table test-table [id=68784c1063604339ae25ad7996dbc4e6]) successfully deleted
I20260809 18:48:40.822172 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 31818
W20260809 18:48:40.845125 31654 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.202.193:37897 (error 108)
W20260809 18:48:40.845927 32523 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:48:40.845641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:37897 (local address 127.0.0.1:51726)
0809 18:48:40.845701 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0809 18:48:40.845716 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:48:40.845783 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:48:40.845873 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:37897: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 18:48:40.846073 31654 catalog_manager.cc:4584] TS 4cb7121944514c5d8580e8c739f98547 (127.12.202.193:37897): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 136a366f97d849ef93795be87f2f32dd: Network error: Client connection negotiation failed: client connection to 127.12.202.193:37897: BlockingWrite error: write error: Connection reset by peer (error 104)
I20260809 18:48:40.846477 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 32037
I20260809 18:48:40.860505 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 32276
I20260809 18:48:40.889700 32523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.889536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:37897 (local address 127.0.0.1:51738)
0809 18:48:40.889594 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0809 18:48:40.889651 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:37897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 18:48:40.898285 32523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.898144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:37897 (local address 127.0.0.1:51752)
0809 18:48:40.898206 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0809 18:48:40.898238 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:37897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 18:48:40.898572 32523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.898503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:37897 (local address 127.0.0.1:51756)
0809 18:48:40.898534 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0809 18:48:40.898553 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:37897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260809 18:48:40.898788 32523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:48:40.898728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:37897 (local address 127.0.0.1:51758)
0809 18:48:40.898753 (+ 25us) negotiation.cc:107] Waiting for socket to connect
0809 18:48:40.898770 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:37897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260809 18:48:40.901307 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 31616
I20260809 18:48:40.914552 13099 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 18:48:41.259517 13099 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 18:48:41.259653 13099 mini_ranger.cc:66] Stopping Ranger...
I20260809 18:48:41.614801 13099 mini_ranger.cc:68] Stopped Ranger
2026-08-09 18:48:41.615 UTC [30898] LOG: received smart shutdown request
2026-08-09 18:48:41.619 UTC [30898] LOG: background worker "logical replication launcher" (PID 30910) exited with exit code 1
2026-08-09 18:48:41.619 UTC [30903] LOG: shutting down
2026-08-09 18:48:41.774 UTC [30898] LOG: database system is shut down
2026-08-09T18:48:41Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (48828 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:48:41 dist-test-slave-45dx krb5kdc[32592](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:48:41 dist-test-slave-45dx krb5kdc[32592](info): set up 2 sockets
Aug 09 18:48:41 dist-test-slave-45dx krb5kdc[32592](info): commencing operation
krb5kdc: starting...
W20260809 18:48:43.145076 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:48:43 dist-test-slave-45dx krb5kdc[32592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:48:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:48:43Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.202.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.202.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.202.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/rangeradmin_127.12.202.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.202.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/rangeradmin_127.12.202.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.202.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.202.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.202.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/rangerlookup_127.12.202.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.202.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/rangerlookup_127.12.202.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.202.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.202.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.202.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/HTTP_127.12.202.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.202.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/HTTP_127.12.202.212@KRBTEST.COM.keytab.
I20260809 18:48:43.315713 13099 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskr0scnw/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/postgres -l logfile start
2026-08-09 18:48:45.744 UTC [32641] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 18:48:45.745 UTC [32641] LOG: listening on IPv4 address "127.12.202.212", port 36515
2026-08-09 18:48:45.748 UTC [32641] LOG: listening on Unix socket "/tmp/.s.PGSQL.36515"
2026-08-09 18:48:45.769 UTC [32645] LOG: database system was shut down at 2026-08-09 18:48:44 UTC
2026-08-09 18:48:45.773 UTC [32641] LOG: database system is ready to accept connections
I20260809 18:48:46.941712 13099 mini_postgres.cc:96] Postgres bound to 36515
2026-08-09 18:48:46.949 UTC [32656] FATAL: database "slave" does not exist
127.12.202.212:36515 - accepting connections
I20260809 18:48:46.949712 13099 mini_ranger.cc:161] Starting Ranger...
I20260809 18:48:46.965277 13099 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 18:48:47.418170 13099 mini_ranger.cc:87] Created ranger Postgres database
I20260809 18:48:47.418259 13099 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-admin
2026-08-09 18:48:47,707 [I] DB FLAVOR :POSTGRES
2026-08-09 18:48:47,707 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 18:48:47,707 [I] Checking connection..
2026-08-09 18:48:47,707 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 18:48:47,963 [I] Checking connection passed.
2026-08-09 18:48:47,964 [I] --------- Verifying version history table ---------
2026-08-09 18:48:47,964 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 18:48:48,235 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 18:48:48,235 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 18:48:48,495 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 18:48:48,496 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 18:48:48,496 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 18:48:48.755 UTC [32754] WARNING: there is no transaction in progress
2026-08-09 18:48:48,766 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 18:48:48,766 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 18:48:49,022 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 18:48:49,023 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 18:48:49,023 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 18:48:49,278 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 18:48:49,522 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-45dx.c.gcp-upstream.internal','N') ;"
2026-08-09 18:48:49,767 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 18:48:50,011 [I] Table x_portal_user does not exist in database ranger
2026-08-09 18:48:50,012 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 18:48:50,263 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 18:48:50,263 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 18:48:50,527 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 18:48:50,788 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 18:48:50,788 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 18:48:51.770 UTC [486] WARNING: there is no transaction in progress
2026-08-09 18:48:51.787 UTC [486] WARNING: there is no transaction in progress
2026-08-09 18:48:51.803 UTC [486] WARNING: there is no transaction in progress
2026-08-09 18:48:51.818 UTC [486] WARNING: there is no transaction in progress
2026-08-09 18:48:51.833 UTC [486] WARNING: there is no transaction in progress
2026-08-09 18:48:51.850 UTC [486] WARNING: there is no transaction in progress
2026-08-09 18:48:51.903 UTC [486] WARNING: there is no transaction in progress
2026-08-09 18:48:51.909 UTC [486] WARNING: there is no transaction in progress
2026-08-09 18:48:51.922 UTC [486] WARNING: there is no transaction in progress
2026-08-09 18:48:51.932 UTC [486] WARNING: there is no transaction in progress
2026-08-09 18:48:51.941 UTC [486] WARNING: there is no transaction in progress
2026-08-09 18:48:51.955 UTC [486] WARNING: there is no transaction in progress
2026-08-09 18:48:51.964 UTC [486] WARNING: there is no transaction in progress
2026-08-09 18:48:51.970 UTC [486] WARNING: there is no transaction in progress
2026-08-09 18:48:51.976 UTC [486] WARNING: there is no transaction in progress
2026-08-09 18:48:51.982 UTC [486] WARNING: there is no transaction in progress
2026-08-09 18:48:52,567 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 18:48:52,567 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 18:48:52,800 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 18:48:52,800 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 18:48:53,061 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 18:48:53,061 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 18:48:53,324 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 18:48:53,325 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 18:48:53,580 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 18:48:53,812 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-45dx.c.gcp-upstream.internal';"
2026-08-09 18:48:54,064 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 18:48:54,064 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 18:48:54,326 [I] DB_PATCHES have already been applied
I20260809 18:48:54.332894 13099 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-admin:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskr0scnw/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 18:48:54.332966 13099 mini_ranger.cc:193] Using host: 127.12.202.212
I20260809 18:48:54.336905 13099 mini_ranger.cc:227] Ranger admin URL: http://127.12.202.212:46123
Aug 09, 2026 6:48:54 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:48:54 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:48:54 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 6:48:54 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 6:48:54 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 6:48:55 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 6:48:55 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 18:48:55.710047 13099 mini_ranger.cc:160] Time spent starting Ranger: real 8.760s user 0.000s sys 0.011s
Aug 09, 2026 6:49:15 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 6:49:15 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 6:49:15 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 6:49:15 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 6:49:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 6:49:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 6:49:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 6:49:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 6:49:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 6:49:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 6:49:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 6:49:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 6:49:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 6:49:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 6:49:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 6:49:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 6:49:15 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 6:49:16 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 18:49:17.297240 13099 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.202.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.202.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.202.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/rangerkms_127.12.202.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.202.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/rangerkms_127.12.202.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.202.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.202.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.202.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/HTTP_127.12.202.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.202.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/HTTP_127.12.202.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 18:49:17 dist-test-slave-45dx krb5kdc[32592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301357, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 18:49:17.394953 13099 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 18:49:17.405572 13099 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 18:49:18.242266 13099 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 18:49:18.242362 13099 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-kms
I20260809 18:49:18.242395 13099 mini_ranger_kms.cc:227] Using postgres at 127.12.202.212:36515
2026-08-09 18:49:18,412 [I] DB FLAVOR :POSTGRES
2026-08-09 18:49:18,413 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 18:49:18,413 [I] Checking connection
2026-08-09 18:49:18,413 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 18:49:18,657 [I] connection success
2026-08-09 18:49:18,657 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 18:49:18,657 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 18:49:18,657 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 18:49:18,883 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 18:49:18,884 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 18:49:18,884 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 18:49:18,884 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.202.212:36515/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 18:49:19,134 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 18:49:19.595973 13099 mini_ranger_kms.cc:310] Created kms service
I20260809 18:49:19.769845 13099 mini_ranger_kms.cc:326] Created kudu user
I20260809 18:49:19.816294 13099 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 18:49:19 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301357, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
I20260809 18:49:20.221755 13099 mini_ranger_kms.cc:384] Added ranger policy
I20260809 18:49:20.221884 13099 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-kms:/tmp/dist-test-taskr0scnw/build/release/bin/postgresql.jar:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskr0scnw/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 18:49:20.221907 13099 mini_ranger_kms.cc:240] Using host: 127.12.202.212
I20260809 18:49:20.226716 13099 mini_ranger_kms.cc:276] Ranger KMS PID: 780
I20260809 18:49:20.226806 13099 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.202.212:34337
Aug 09, 2026 6:49:21 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:49:21 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:49:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 6:49:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 6:49:22 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 6:49:22 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 18:49:22 dist-test-slave-45dx krb5kdc[32592](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786301362, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.202.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:23.056856 13099 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.662s user 0.003s sys 0.151s
I20260809 18:49:23.057027 13099 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 18:49:23.057081 13099 mini_ranger_kms.cc:401] 127.12.202.212:34337/kms/v1/keys
Aug 09 18:49:23 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301362, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.202.212@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
Aug 09 18:49:23 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301362, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.202.212@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
Aug 09 18:49:25 dist-test-slave-45dx krb5kdc[32592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301365, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:49:25.843819 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:38199
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:33575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:38199
--ranger_config_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.202.212:34337/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:49:25.925071 864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:25.925279 864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:25.925302 864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:25.926431 864 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:49:25.926472 864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:25.926486 864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:25.926499 864 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:49:25.926512 864 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:49:25.928182 864 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:33575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.202.212:34337/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:38199
--ranger_config_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:38199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.864
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:25.928427 864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:25.928673 864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:25.933748 870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:25.933843 876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:25.933733 872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:25.934080 864 server_base.cc:1034] running on GCE node
I20260809 18:49:25.934475 864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:25.934806 864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:25.935994 864 hybrid_clock.cc:648] HybridClock initialized: now 1786301365935972 us; error 40 us; skew 500 ppm
Aug 09 18:49:25 dist-test-slave-45dx krb5kdc[32592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301365, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:25.938789 864 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:49:25.939291 864 webserver.cc:460] Webserver started at http://127.12.202.254:33141/ using document root <none> and password file <none>
I20260809 18:49:25.939538 864 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:25.939587 864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:25.939705 864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:49:25 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301365, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
I20260809 18:49:25.986651 864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "459d89ff8df14aa5a294e8b6207eaab6"
format_stamp: "Formatted at 2026-08-09 18:49:25 on dist-test-slave-45dx"
server_key: "76091ffd83fd69ccf98ad705a62f9c1f"
server_key_iv: "2fccd782e44b100203e2630e978ae88f"
server_key_version: "kuduclusterkey@0"
I20260809 18:49:25.987210 864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "459d89ff8df14aa5a294e8b6207eaab6"
format_stamp: "Formatted at 2026-08-09 18:49:25 on dist-test-slave-45dx"
server_key: "76091ffd83fd69ccf98ad705a62f9c1f"
server_key_iv: "2fccd782e44b100203e2630e978ae88f"
server_key_version: "kuduclusterkey@0"
I20260809 18:49:25.989610 864 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260809 18:49:26.005095 886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:26.005335 864 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:49:26.005434 864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "459d89ff8df14aa5a294e8b6207eaab6"
format_stamp: "Formatted at 2026-08-09 18:49:25 on dist-test-slave-45dx"
server_key: "76091ffd83fd69ccf98ad705a62f9c1f"
server_key_iv: "2fccd782e44b100203e2630e978ae88f"
server_key_version: "kuduclusterkey@0"
I20260809 18:49:26.005528 864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:26.040537 864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:26.042832 864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:26.042995 864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:26.048053 864 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:38199
I20260809 18:49:26.048086 967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:38199 every 8 connection(s)
I20260809 18:49:26.048527 864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:49:26.049249 968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:26.050037 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 864
I20260809 18:49:26.050153 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:49:26.050364 13099 external_mini_cluster.cc:1428] Setting key 5c2335d7a9d743e6d3a0fd2f8c05b635
I20260809 18:49:26.052650 968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6: Bootstrap starting.
I20260809 18:49:26.053284 968 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:26.053582 968 log.cc:824] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:26.054351 968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6: No bootstrap required, opened a new log
I20260809 18:49:26.056746 968 raft_consensus.cc:348] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "459d89ff8df14aa5a294e8b6207eaab6" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38199 } }
I20260809 18:49:26.056932 968 raft_consensus.cc:374] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:26.056974 968 raft_consensus.cc:729] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459d89ff8df14aa5a294e8b6207eaab6, State: Initialized, Role: FOLLOWER
I20260809 18:49:26.057147 968 consensus_queue.cc:260] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "459d89ff8df14aa5a294e8b6207eaab6" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38199 } }
I20260809 18:49:26.057229 968 raft_consensus.cc:388] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:49:26.057260 968 raft_consensus.cc:482] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:49:26.057329 968 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:26.057878 968 raft_consensus.cc:504] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "459d89ff8df14aa5a294e8b6207eaab6" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38199 } }
I20260809 18:49:26.058000 968 leader_election.cc:302] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 459d89ff8df14aa5a294e8b6207eaab6; no voters:
Aug 09 18:49:26 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301365, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:26.058187 968 leader_election.cc:288] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:49:26.058215 979 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:49:26.058360 979 raft_consensus.cc:686] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [term 1 LEADER]: Becoming Leader. State: Replica: 459d89ff8df14aa5a294e8b6207eaab6, State: Running, Role: LEADER
I20260809 18:49:26.058468 968 sys_catalog.cc:564] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:49:26.058513 979 consensus_queue.cc:237] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "459d89ff8df14aa5a294e8b6207eaab6" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38199 } }
I20260809 18:49:26.058890 979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "459d89ff8df14aa5a294e8b6207eaab6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "459d89ff8df14aa5a294e8b6207eaab6" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38199 } } }
I20260809 18:49:26.059057 979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [sys.catalog]: This master's current role is: LEADER
I20260809 18:49:26.059249 979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 459d89ff8df14aa5a294e8b6207eaab6. Latest consensus state: current_term: 1 leader_uuid: "459d89ff8df14aa5a294e8b6207eaab6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "459d89ff8df14aa5a294e8b6207eaab6" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38199 } } }
I20260809 18:49:26.059352 979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [sys.catalog]: This master's current role is: LEADER
I20260809 18:49:26.059512 993 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:49:26.060138 993 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:49:26.060482 968 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 18:49:26.062748 977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:26.050913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49206 (local address 127.12.202.254:38199)
0809 18:49:26.051105 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:26.051115 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:26.051148 (+ 33us) server_negotiation.cc:407] Connection header received
0809 18:49:26.051701 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:26.051710 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:26.051769 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:26.051910 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:26.052740 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:26.054072 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:26.055150 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:26.055731 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:26.055837 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:26.058796 (+ 2959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:26.058800 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:26.058800 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:26.058811 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:26.060790 (+ 1979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:26.061189 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:26.061192 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:26.061193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:26.061299 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:26.061502 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:26.061503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:26.061503 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:26.061801 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:26.062369 (+ 568us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:26.062438 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 18:49:26.062551 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":86,"threads_started":1}
I20260809 18:49:26.068831 993 catalog_manager.cc:1347] Generated new cluster ID: 9a5245112c594631a23a2bd8387aadb8
I20260809 18:49:26.068933 993 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:49:26.083379 993 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:49:26.084203 993 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:49:26.088364 993 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6: Generated new TSK 0
I20260809 18:49:26.088601 993 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
I20260809 18:49:26.801306 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.202.212:34337/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:38199
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:33575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:49:26.893407 1047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:26.893610 1047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:26.893632 1047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:26.894769 1047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:26.894814 1047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:26.894841 1047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:49:26.896456 1047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:33575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.202.212:34337/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:38199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:26.896689 1047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:26.896937 1047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:26.903059 1055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:26.903116 1053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:26.903350 1052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:26.903472 1047 server_base.cc:1034] running on GCE node
I20260809 18:49:26.903666 1047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:26.903927 1047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:26.905081 1047 hybrid_clock.cc:648] HybridClock initialized: now 1786301366905048 us; error 46 us; skew 500 ppm
Aug 09 18:49:26 dist-test-slave-45dx krb5kdc[32592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301366, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:26.908511 1047 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:49:26.909055 1047 webserver.cc:460] Webserver started at http://127.12.202.193:40835/ using document root <none> and password file <none>
I20260809 18:49:26.909406 1047 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:26.909477 1047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:26.909626 1047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:49:26 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301366, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
I20260809 18:49:26.923691 1047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "a31576859dd948faafb437c6f6b51a42"
format_stamp: "Formatted at 2026-08-09 18:49:26 on dist-test-slave-45dx"
server_key: "707a8cbefcd27bb3173f55250e4bb53b"
server_key_iv: "525d38a0003e708cd44a1f2e11ea649e"
server_key_version: "kuduclusterkey@0"
I20260809 18:49:26.924212 1047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "a31576859dd948faafb437c6f6b51a42"
format_stamp: "Formatted at 2026-08-09 18:49:26 on dist-test-slave-45dx"
server_key: "707a8cbefcd27bb3173f55250e4bb53b"
server_key_iv: "525d38a0003e708cd44a1f2e11ea649e"
server_key_version: "kuduclusterkey@0"
I20260809 18:49:26.926059 1047 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260809 18:49:26.942232 1066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:26.942451 1047 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 18:49:26.942554 1047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "a31576859dd948faafb437c6f6b51a42"
format_stamp: "Formatted at 2026-08-09 18:49:26 on dist-test-slave-45dx"
server_key: "707a8cbefcd27bb3173f55250e4bb53b"
server_key_iv: "525d38a0003e708cd44a1f2e11ea649e"
server_key_version: "kuduclusterkey@0"
I20260809 18:49:26.942636 1047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:26.970744 1047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:26.973451 1047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:26.973625 1047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:26.973820 1047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:49:26.974187 1047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:49:26.974249 1047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:26.974290 1047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:49:26.974315 1047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:26.981261 1047 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:44763
I20260809 18:49:26.981340 1265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:44763 every 8 connection(s)
I20260809 18:49:26.981609 1047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
Aug 09 18:49:26 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301366, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:26.989395 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 1047
I20260809 18:49:26.989519 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:49:26.989748 13099 external_mini_cluster.cc:1428] Setting key 5a50a694d6f851993d157f0f24619f11
I20260809 18:49:26.995659 1273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:26.982446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:53117 (local address 127.12.202.254:38199)
0809 18:49:26.983245 (+ 799us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:26.983246 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:26.983253 (+ 7us) server_negotiation.cc:407] Connection header received
0809 18:49:26.983275 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:26.983275 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:26.983286 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:26.983380 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:26.983960 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:26.984766 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:26.986269 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:26.986572 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:26.986644 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:26.989995 (+ 3351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:26.989996 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:26.989997 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:26.990005 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:26.993809 (+ 3804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:26.994329 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:26.994330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:26.994331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:26.994423 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:26.994744 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:26.994745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:26.994745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:26.994905 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:26.994977 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:26.995340 (+ 363us) server_negotiation.cc:299] Negotiation successful
0809 18:49:26.995501 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":767,"thread_start_us":97,"threads_started":1}
I20260809 18:49:26.995690 1271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:26.982396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:38199 (local address 127.12.202.193:53117)
0809 18:49:26.982573 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:26.982616 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:26.983099 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:26.983458 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:26.983463 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:26.983656 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:26.983848 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:26.983852 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:26.984894 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:26.984895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:26.986165 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:26.986169 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:26.986687 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:26.986688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:26.986829 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:26.987428 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:26.987439 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:26.989106 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:26.993928 (+ 4822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:26.993935 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:26.993938 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:26.994242 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:26.994506 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:26.994506 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:26.994507 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:26.994662 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:26.994990 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:26.994997 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:26.995165 (+ 168us) client_negotiation.cc:769] Sending connection context
0809 18:49:26.995297 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 18:49:26.995461 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":101,"threads_started":1}
I20260809 18:49:26.996538 1266 heartbeater.cc:347] Connected to a master server at 127.12.202.254:38199
I20260809 18:49:26.996642 1266 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:26.996899 1266 heartbeater.cc:511] Master 127.12.202.254:38199 requested a full tablet report, sending...
I20260809 18:49:26.997531 918 ts_manager.cc:194] Registered new tserver with Master: a31576859dd948faafb437c6f6b51a42 (127.12.202.193:44763)
I20260809 18:49:26.998414 918 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:53117
WARNING: no policy specified for kudu/127.12.202.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
I20260809 18:49:27.023056 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.202.212:34337/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:38199
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:33575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:49:27 dist-test-slave-45dx krb5kdc[32592](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786301367, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 18:49:27.142712 1276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:27.143056 1276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:27.143144 1276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:27.144752 1276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:27.144819 1276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:27.144856 1276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:49:27.146930 1276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:33575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.202.212:34337/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:38199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:27.147305 1276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:27.147596 1276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:27.154518 1293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:27.154587 1292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:27.154970 1276 server_base.cc:1034] running on GCE node
W20260809 18:49:27.155642 1295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:27.155933 1276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:27.156208 1276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:27.157378 1276 hybrid_clock.cc:648] HybridClock initialized: now 1786301367157356 us; error 34 us; skew 500 ppm
Aug 09 18:49:27 dist-test-slave-45dx krb5kdc[32592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301367, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:27.160854 1276 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:49:27.161325 1276 webserver.cc:460] Webserver started at http://127.12.202.194:46165/ using document root <none> and password file <none>
I20260809 18:49:27.161593 1276 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:27.161648 1276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:27.161793 1276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:49:27 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301367, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
I20260809 18:49:27.186012 1276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "7ace72368dcf4504b02b7afa8a883274"
format_stamp: "Formatted at 2026-08-09 18:49:27 on dist-test-slave-45dx"
server_key: "8d3d6d1b35cd8a75906ecd79a23d8d5b"
server_key_iv: "230542886d31be6800fc6b18d061b956"
server_key_version: "kuduclusterkey@0"
I20260809 18:49:27.186463 1276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "7ace72368dcf4504b02b7afa8a883274"
format_stamp: "Formatted at 2026-08-09 18:49:27 on dist-test-slave-45dx"
server_key: "8d3d6d1b35cd8a75906ecd79a23d8d5b"
server_key_iv: "230542886d31be6800fc6b18d061b956"
server_key_version: "kuduclusterkey@0"
I20260809 18:49:27.188247 1276 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 18:49:27.201491 1306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:27.201758 1276 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:49:27.201866 1276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "7ace72368dcf4504b02b7afa8a883274"
format_stamp: "Formatted at 2026-08-09 18:49:27 on dist-test-slave-45dx"
server_key: "8d3d6d1b35cd8a75906ecd79a23d8d5b"
server_key_iv: "230542886d31be6800fc6b18d061b956"
server_key_version: "kuduclusterkey@0"
I20260809 18:49:27.201954 1276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:27.231693 1276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:27.234251 1276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:27.234400 1276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:27.234645 1276 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:49:27.235021 1276 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:49:27.235069 1276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:27.235102 1276 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:49:27.235173 1276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:27.245663 1276 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:40591
I20260809 18:49:27.245774 1508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:40591 every 8 connection(s)
I20260809 18:49:27.246093 1276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:49:27.251309 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 1276
I20260809 18:49:27.251469 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:49:27.251672 13099 external_mini_cluster.cc:1428] Setting key a71747311fe7a05fba44e7538817a771
Aug 09 18:49:27 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301367, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:27.257388 1273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:27.246871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:35619 (local address 127.12.202.254:38199)
0809 18:49:27.247066 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:27.247068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:27.247137 (+ 69us) server_negotiation.cc:407] Connection header received
0809 18:49:27.247893 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:27.247893 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:27.247906 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:27.247964 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:27.248722 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:27.249182 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:27.250659 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:27.250859 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:27.250925 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:27.253803 (+ 2878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:27.253805 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:27.253806 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:27.253815 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:27.255645 (+ 1830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:27.256153 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:27.256154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:27.256155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:27.256218 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:27.256606 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:27.256607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:27.256607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:27.256748 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:27.256793 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:27.257174 (+ 381us) server_negotiation.cc:299] Negotiation successful
0809 18:49:27.257284 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167}
I20260809 18:49:27.257920 1515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:27.246833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:38199 (local address 127.12.202.194:35619)
0809 18:49:27.247003 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:27.247054 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:27.247760 (+ 706us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:27.248046 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:27.248050 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:27.248322 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:27.248623 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:27.248629 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:27.249281 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:27.249282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:27.250547 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:27.250550 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:27.250970 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:27.250971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:27.251145 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:27.251838 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:27.251980 (+ 142us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:27.253692 (+ 1712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:27.255758 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:27.255765 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:27.255767 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:27.256060 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:27.256310 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:27.256311 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:27.256311 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:27.256501 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:27.256843 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:27.256849 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:27.257016 (+ 167us) client_negotiation.cc:769] Sending connection context
0809 18:49:27.257523 (+ 507us) client_negotiation.cc:240] Negotiation successful
0809 18:49:27.257697 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
I20260809 18:49:27.258553 1512 heartbeater.cc:347] Connected to a master server at 127.12.202.254:38199
I20260809 18:49:27.258687 1512 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:27.258878 1512 heartbeater.cc:511] Master 127.12.202.254:38199 requested a full tablet report, sending...
I20260809 18:49:27.259248 918 ts_manager.cc:194] Registered new tserver with Master: 7ace72368dcf4504b02b7afa8a883274 (127.12.202.194:40591)
I20260809 18:49:27.259735 918 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:35619
WARNING: no policy specified for kudu/127.12.202.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
I20260809 18:49:27.291776 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.202.212:34337/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:38199
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:33575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:49:27.403007 1522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:27.403218 1522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:27.403241 1522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:27.404421 1522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:27.404461 1522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:27.404486 1522 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:49:27.406152 1522 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:33575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.202.212:34337/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:38199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:27.406533 1522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:27.406826 1522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:27.419224 1530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:27.419317 1532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:27.419222 1528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:27.420463 1522 server_base.cc:1034] running on GCE node
I20260809 18:49:27.420786 1522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:27.421115 1522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:27.422349 1522 hybrid_clock.cc:648] HybridClock initialized: now 1786301367422328 us; error 35 us; skew 500 ppm
Aug 09 18:49:27 dist-test-slave-45dx krb5kdc[32592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301367, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:27.425694 1522 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:49:27.426257 1522 webserver.cc:460] Webserver started at http://127.12.202.195:41841/ using document root <none> and password file <none>
I20260809 18:49:27.426519 1522 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:27.426584 1522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:27.426771 1522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 18:49:27 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301367, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
I20260809 18:49:27.440754 1522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "fb2dff7224144b03baf67987faac641b"
format_stamp: "Formatted at 2026-08-09 18:49:27 on dist-test-slave-45dx"
server_key: "da79e56504f99df7245d398b14f8a534"
server_key_iv: "e022b35c6e9c8142cb70507beeb084c9"
server_key_version: "kuduclusterkey@0"
I20260809 18:49:27.441473 1522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "fb2dff7224144b03baf67987faac641b"
format_stamp: "Formatted at 2026-08-09 18:49:27 on dist-test-slave-45dx"
server_key: "da79e56504f99df7245d398b14f8a534"
server_key_iv: "e022b35c6e9c8142cb70507beeb084c9"
server_key_version: "kuduclusterkey@0"
I20260809 18:49:27.446525 1522 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.000s
I20260809 18:49:27.468655 1545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:27.470158 1522 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 18:49:27.470299 1522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "fb2dff7224144b03baf67987faac641b"
format_stamp: "Formatted at 2026-08-09 18:49:27 on dist-test-slave-45dx"
server_key: "da79e56504f99df7245d398b14f8a534"
server_key_iv: "e022b35c6e9c8142cb70507beeb084c9"
server_key_version: "kuduclusterkey@0"
I20260809 18:49:27.470407 1522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:27.493379 1522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:27.496179 1522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:27.496464 1522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:27.496745 1522 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:49:27.497191 1522 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:49:27.497287 1522 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:27.497393 1522 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:49:27.497462 1522 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:27.503991 1522 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:43225
I20260809 18:49:27.504546 1522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:49:27.510434 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 1522
I20260809 18:49:27.510569 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:49:27.510758 13099 external_mini_cluster.cc:1428] Setting key f053cf4f2ed3b7dd0e7713a13ed28f1e
I20260809 18:49:27.507254 1721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:43225 every 8 connection(s)
Aug 09 18:49:27 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301367, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:27.520629 1273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:27.508125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:32921 (local address 127.12.202.254:38199)
0809 18:49:27.508172 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:27.508174 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:27.508547 (+ 373us) server_negotiation.cc:407] Connection header received
0809 18:49:27.509311 (+ 764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:27.509323 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:27.509335 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:27.509367 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:27.511775 (+ 2408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:27.512596 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:27.514150 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:27.514446 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:27.514494 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:27.517302 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:27.517303 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:27.517303 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:27.517311 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:27.519077 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:27.519569 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:27.519570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:27.519571 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:27.519628 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:27.519893 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:27.519894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:27.519894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:27.520017 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:27.520057 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:27.520448 (+ 391us) server_negotiation.cc:299] Negotiation successful
0809 18:49:27.520535 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:49:27.521401 1725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:27.507845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:38199 (local address 127.12.202.195:32921)
0809 18:49:27.508411 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:27.508457 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:27.509151 (+ 694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:27.509596 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:27.509600 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:27.509837 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:27.510160 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:27.510166 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:27.512801 (+ 2635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:27.512802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:27.514050 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:27.514053 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:27.514600 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:27.514601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:27.514753 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:27.515403 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:27.515414 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:27.517183 (+ 1769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:27.519173 (+ 1990us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:27.519179 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:27.519182 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:27.519476 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:27.519696 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:27.519697 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:27.519697 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:27.519822 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:27.520101 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:27.520106 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:27.520258 (+ 152us) client_negotiation.cc:769] Sending connection context
0809 18:49:27.520987 (+ 729us) client_negotiation.cc:240] Negotiation successful
0809 18:49:27.521152 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":90,"threads_started":1}
I20260809 18:49:27.522585 1723 heartbeater.cc:347] Connected to a master server at 127.12.202.254:38199
I20260809 18:49:27.522676 1723 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:27.522858 1723 heartbeater.cc:511] Master 127.12.202.254:38199 requested a full tablet report, sending...
I20260809 18:49:27.523257 918 ts_manager.cc:194] Registered new tserver with Master: fb2dff7224144b03baf67987faac641b (127.12.202.195:43225)
I20260809 18:49:27.523731 918 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:32921
I20260809 18:49:27.533155 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:49:27.533977 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 1047
I20260809 18:49:27.596369 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 1276
I20260809 18:49:27.610265 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 1522
I20260809 18:49:27.629580 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 864
I20260809 18:49:27.659931 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:38199
--webserver_interface=127.12.202.254
--webserver_port=33141
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:33575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:38199
--ranger_config_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.202.212:34337/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.202.212:34337/kms with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:49:27.741549 1729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:27.741791 1729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:27.741816 1729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:27.742987 1729 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:49:27.743032 1729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:27.743046 1729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:27.743058 1729 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:49:27.743109 1729 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:49:27.744818 1729 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:33575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.202.212:34337/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:38199
--ranger_config_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:38199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=33141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:27.745075 1729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:27.745309 1729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:27.750504 1734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:27.750598 1729 server_base.cc:1034] running on GCE node
W20260809 18:49:27.750511 1735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:27.750511 1738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:27.751093 1729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:27.751362 1729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:27.752501 1729 hybrid_clock.cc:648] HybridClock initialized: now 1786301367752489 us; error 32 us; skew 500 ppm
Aug 09 18:49:27 dist-test-slave-45dx krb5kdc[32592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301367, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:27.755052 1729 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:49:27.755442 1729 webserver.cc:460] Webserver started at http://127.12.202.254:33141/ using document root <none> and password file <none>
I20260809 18:49:27.755615 1729 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:27.755663 1729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 18:49:27 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301367, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
I20260809 18:49:27.831758 1729 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:49:27.832623 1747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:27.832846 1729 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:49:27.832964 1729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "459d89ff8df14aa5a294e8b6207eaab6"
format_stamp: "Formatted at 2026-08-09 18:49:25 on dist-test-slave-45dx"
server_key: "76091ffd83fd69ccf98ad705a62f9c1f"
server_key_iv: "2fccd782e44b100203e2630e978ae88f"
server_key_version: "kuduclusterkey@0"
I20260809 18:49:27.833388 1729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:27.841792 1729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:27.843935 1729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:27.844100 1729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:27.848459 1729 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:38199
I20260809 18:49:27.848505 1829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:38199 every 8 connection(s)
I20260809 18:49:27.848877 1729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:49:27.850104 1830 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:49:27.850800 1830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6: Bootstrap starting.
I20260809 18:49:27.856490 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 1729
I20260809 18:49:27.856784 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.202.212:34337/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:44763
--local_ip_for_outbound_sockets=127.12.202.193
--tserver_master_addrs=127.12.202.254:38199
--webserver_port=40835
--webserver_interface=127.12.202.193
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:33575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.202.212:34337/kms with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:49:27.859018 1830 log.cc:824] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:27.860819 1830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:49:27.861131 1830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6: Bootstrap complete.
I20260809 18:49:27.863512 1830 raft_consensus.cc:348] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "459d89ff8df14aa5a294e8b6207eaab6" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38199 } }
I20260809 18:49:27.863765 1830 raft_consensus.cc:729] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459d89ff8df14aa5a294e8b6207eaab6, State: Initialized, Role: FOLLOWER
I20260809 18:49:27.863982 1830 consensus_queue.cc:260] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "459d89ff8df14aa5a294e8b6207eaab6" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38199 } }
I20260809 18:49:27.864107 1830 raft_consensus.cc:388] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:49:27.864164 1830 raft_consensus.cc:482] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:49:27.864217 1830 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [term 1 FOLLOWER]: Advancing to term 2
I20260809 18:49:27.865273 1830 raft_consensus.cc:504] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "459d89ff8df14aa5a294e8b6207eaab6" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38199 } }
I20260809 18:49:27.865412 1830 leader_election.cc:302] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 459d89ff8df14aa5a294e8b6207eaab6; no voters:
I20260809 18:49:27.865624 1830 leader_election.cc:288] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 18:49:27.865690 1838 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 18:49:27.865916 1838 raft_consensus.cc:686] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [term 2 LEADER]: Becoming Leader. State: Replica: 459d89ff8df14aa5a294e8b6207eaab6, State: Running, Role: LEADER
I20260809 18:49:27.865950 1830 sys_catalog.cc:564] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:49:27.867595 1838 consensus_queue.cc:237] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "459d89ff8df14aa5a294e8b6207eaab6" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38199 } }
I20260809 18:49:27.868148 1845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "459d89ff8df14aa5a294e8b6207eaab6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "459d89ff8df14aa5a294e8b6207eaab6" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38199 } } }
I20260809 18:49:27.868240 1845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [sys.catalog]: This master's current role is: LEADER
I20260809 18:49:27.868340 1830 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 18:49:27.868448 1839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 459d89ff8df14aa5a294e8b6207eaab6. Latest consensus state: current_term: 2 leader_uuid: "459d89ff8df14aa5a294e8b6207eaab6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "459d89ff8df14aa5a294e8b6207eaab6" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 38199 } } }
I20260809 18:49:27.868505 1839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6 [sys.catalog]: This master's current role is: LEADER
I20260809 18:49:27.868589 1868 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:49:27.871241 1868 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:49:27.871598 1868 catalog_manager.cc:1259] Loaded cluster ID: 9a5245112c594631a23a2bd8387aadb8
I20260809 18:49:27.871685 1868 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:49:27.873368 1868 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:49:27.873610 1868 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6: Loaded TSK: 0
I20260809 18:49:27.873883 1868 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 18:49:27.952037 1833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:27.952564 1833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:27.952636 1833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:27.954378 1833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:27.954442 1833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:27.954483 1833 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:49:27.956714 1833 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:33575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.202.212:34337/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:44763
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=40835
--tserver_master_addrs=127.12.202.254:38199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1833
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:27.956952 1833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:27.957243 1833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:27.964542 1906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:27.964702 1901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:27.964927 1899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:27.964959 1833 server_base.cc:1034] running on GCE node
I20260809 18:49:27.965189 1833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:27.965472 1833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:27.966652 1833 hybrid_clock.cc:648] HybridClock initialized: now 1786301367966618 us; error 43 us; skew 500 ppm
Aug 09 18:49:27 dist-test-slave-45dx krb5kdc[32592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301367, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:27.970024 1833 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:49:27.970570 1833 webserver.cc:460] Webserver started at http://127.12.202.193:40835/ using document root <none> and password file <none>
I20260809 18:49:27.970861 1833 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:27.970973 1833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 18:49:27 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301367, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
I20260809 18:49:27.992899 1833 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.000s
I20260809 18:49:27.994134 1920 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:27.994359 1833 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:49:27.994465 1833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "a31576859dd948faafb437c6f6b51a42"
format_stamp: "Formatted at 2026-08-09 18:49:26 on dist-test-slave-45dx"
server_key: "707a8cbefcd27bb3173f55250e4bb53b"
server_key_iv: "525d38a0003e708cd44a1f2e11ea649e"
server_key_version: "kuduclusterkey@0"
I20260809 18:49:27.994933 1833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:28.037461 1833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:28.043465 1833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:28.043711 1833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:28.044169 1833 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:49:28.044610 1833 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:49:28.044703 1833 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:28.044803 1833 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:49:28.044878 1833 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:28.051950 1833 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:44763
I20260809 18:49:28.052486 1833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:49:28.055104 2108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:44763 every 8 connection(s)
I20260809 18:49:28.060690 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 1833
I20260809 18:49:28.060999 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.202.212:34337/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:40591
--local_ip_for_outbound_sockets=127.12.202.194
--tserver_master_addrs=127.12.202.254:38199
--webserver_port=46165
--webserver_interface=127.12.202.194
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:33575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.202.212:34337/kms with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:49:28 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301367, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:28.076357 2117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:28.056515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:38199 (local address 127.12.202.193:55419)
0809 18:49:28.059786 (+ 3271us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:28.059831 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:28.063039 (+ 3208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:28.065190 (+ 2151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:28.065195 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:28.065435 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:28.065717 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:28.065723 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:28.067358 (+ 1635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:28.067359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:28.068613 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:28.068616 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:28.069582 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:28.069583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:28.069738 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:28.070392 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:28.070402 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:28.071952 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:28.074393 (+ 2441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:28.074400 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:28.074402 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:28.074699 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:28.075009 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:28.075010 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:28.075010 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:28.075143 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:28.075643 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:28.075649 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:28.075794 (+ 145us) client_negotiation.cc:769] Sending connection context
0809 18:49:28.075922 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 18:49:28.076083 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3232,"thread_start_us":108,"threads_started":1}
I20260809 18:49:28.077373 2118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:28.056806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:55419 (local address 127.12.202.254:38199)
0809 18:49:28.057021 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:28.057030 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:28.064736 (+ 7706us) server_negotiation.cc:407] Connection header received
0809 18:49:28.064905 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:28.064913 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:28.064972 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:28.065850 (+ 878us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:28.065949 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:28.067251 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:28.068727 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:28.069354 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:28.069461 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:28.072083 (+ 2622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:28.072088 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:28.072089 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:28.072101 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:28.074295 (+ 2194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:28.074797 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:28.074800 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:28.074801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:28.074921 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:28.075220 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:28.075221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:28.075221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:28.075521 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:28.075611 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:28.077043 (+ 1432us) server_negotiation.cc:299] Negotiation successful
0809 18:49:28.077171 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":116,"threads_started":1}
I20260809 18:49:28.078380 2110 heartbeater.cc:347] Connected to a master server at 127.12.202.254:38199
I20260809 18:49:28.078493 2110 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:28.078692 2110 heartbeater.cc:511] Master 127.12.202.254:38199 requested a full tablet report, sending...
W20260809 18:49:28.079654 2110 heartbeater.cc:644] Failed to heartbeat to 127.12.202.254:38199 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 18:49:28.079732 2110 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:28.079795 2110 heartbeater.cc:511] Master 127.12.202.254:38199 requested a full tablet report, sending...
I20260809 18:49:28.080163 2110 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:28.080245 2110 heartbeater.cc:511] Master 127.12.202.254:38199 requested a full tablet report, sending...
W20260809 18:49:28.080606 2110 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 18:49:28.174422 2119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:28.174777 2119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:28.174880 2119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:28.176241 2119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:28.176334 2119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:28.176390 2119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:49:28.178514 2119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:33575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.202.212:34337/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:40591
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=46165
--tserver_master_addrs=127.12.202.254:38199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2119
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:28.178887 2119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:28.179142 2119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:28.184733 2130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:28.185437 2128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:28.185539 2119 server_base.cc:1034] running on GCE node
W20260809 18:49:28.188450 2125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:28.188730 2119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:28.188990 2119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:28.196367 2119 hybrid_clock.cc:648] HybridClock initialized: now 1786301368196334 us; error 42 us; skew 500 ppm
Aug 09 18:49:28 dist-test-slave-45dx krb5kdc[32592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301368, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:28.199182 2119 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:49:28.199753 2119 webserver.cc:460] Webserver started at http://127.12.202.194:46165/ using document root <none> and password file <none>
I20260809 18:49:28.200016 2119 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:28.200101 2119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 18:49:28 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301368, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
I20260809 18:49:28.224086 2119 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.001s sys 0.000s
I20260809 18:49:28.225088 2145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:28.225270 2119 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:49:28.225368 2119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "7ace72368dcf4504b02b7afa8a883274"
format_stamp: "Formatted at 2026-08-09 18:49:27 on dist-test-slave-45dx"
server_key: "8d3d6d1b35cd8a75906ecd79a23d8d5b"
server_key_iv: "230542886d31be6800fc6b18d061b956"
server_key_version: "kuduclusterkey@0"
I20260809 18:49:28.225750 2119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:28.236040 2119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:28.238389 2119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:28.238554 2119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:28.238813 2119 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:49:28.239187 2119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:49:28.239236 2119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:28.239265 2119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:49:28.239283 2119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:28.246644 2119 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:40591
I20260809 18:49:28.247092 2119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:49:28.247747 2335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:40591 every 8 connection(s)
I20260809 18:49:28.251143 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 2119
I20260809 18:49:28.251472 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.202.212:34337/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:43225
--local_ip_for_outbound_sockets=127.12.202.195
--tserver_master_addrs=127.12.202.254:38199
--webserver_port=41841
--webserver_interface=127.12.202.195
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:33575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.202.212:34337/kms with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:49:28 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301368, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:28.257439 2341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:28.247905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:38199 (local address 127.12.202.194:43225)
0809 18:49:28.248111 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:28.248151 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:28.248668 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:28.248938 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:28.248942 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:28.249109 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:28.249289 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:28.249293 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:28.250017 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:28.250018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:28.250912 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:28.250915 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:28.251355 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:28.251357 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:28.251471 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:28.252036 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:28.252046 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:28.253602 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:28.255630 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:28.255636 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:28.255638 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:28.255934 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:28.256173 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:28.256174 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:28.256175 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:28.256303 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:28.256691 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:28.256697 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:28.256864 (+ 167us) client_negotiation.cc:769] Sending connection context
0809 18:49:28.256978 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 18:49:28.257146 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":78,"threads_started":1}
I20260809 18:49:28.258208 2118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:28.248179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:43225 (local address 127.12.202.254:38199)
0809 18:49:28.248223 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:28.248225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:28.248236 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:49:28.248781 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:28.248783 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:28.248796 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:28.248861 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:28.249403 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:28.249900 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:28.251003 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:28.251264 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:28.251329 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:28.253712 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:28.253713 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:28.253714 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:28.253723 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:28.255538 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:28.256017 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:28.256019 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:28.256019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:28.256077 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:28.256427 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:28.256428 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:28.256429 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:28.256590 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:28.256662 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:28.257972 (+ 1310us) server_negotiation.cc:299] Negotiation successful
0809 18:49:28.258073 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:49:28.258813 2338 heartbeater.cc:347] Connected to a master server at 127.12.202.254:38199
I20260809 18:49:28.258980 2338 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:28.259227 2338 heartbeater.cc:511] Master 127.12.202.254:38199 requested a full tablet report, sending...
W20260809 18:49:28.260042 2338 heartbeater.cc:644] Failed to heartbeat to 127.12.202.254:38199 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 18:49:28.260185 2338 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:28.260299 2338 heartbeater.cc:511] Master 127.12.202.254:38199 requested a full tablet report, sending...
I20260809 18:49:28.260704 2338 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:28.260903 2338 heartbeater.cc:511] Master 127.12.202.254:38199 requested a full tablet report, sending...
W20260809 18:49:28.268203 2338 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 18:49:28.365638 2343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:28.365912 2343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:28.365954 2343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:28.367795 2343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:28.367899 2343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:28.367980 2343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:49:28.370087 2343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:33575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.202.212:34337/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:43225
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=41841
--tserver_master_addrs=127.12.202.254:38199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:28.370483 2343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:28.370782 2343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:49:28.377586 2343 server_base.cc:1034] running on GCE node
W20260809 18:49:28.377876 2357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:28.378043 2355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:28.378782 2354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:28.379036 2343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:28.379310 2343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:28.380460 2343 hybrid_clock.cc:648] HybridClock initialized: now 1786301368380421 us; error 57 us; skew 500 ppm
Aug 09 18:49:28 dist-test-slave-45dx krb5kdc[32592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301368, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:28.383464 2343 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:49:28.384013 2343 webserver.cc:460] Webserver started at http://127.12.202.195:41841/ using document root <none> and password file <none>
I20260809 18:49:28.384249 2343 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:28.384368 2343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 18:49:28 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301368, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
I20260809 18:49:28.400897 2343 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:49:28.401989 2376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:28.402185 2343 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:49:28.402276 2343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "fb2dff7224144b03baf67987faac641b"
format_stamp: "Formatted at 2026-08-09 18:49:27 on dist-test-slave-45dx"
server_key: "da79e56504f99df7245d398b14f8a534"
server_key_iv: "e022b35c6e9c8142cb70507beeb084c9"
server_key_version: "kuduclusterkey@0"
I20260809 18:49:28.402727 2343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:28.419756 2343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:28.422385 2343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:28.422605 2343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:28.422927 2343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:49:28.423358 2343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:49:28.423449 2343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:28.423528 2343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:49:28.423592 2343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:28.430789 2343 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:43225
I20260809 18:49:28.430886 2568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:43225 every 8 connection(s)
I20260809 18:49:28.431205 2343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:49:28 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301368, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:28.439616 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 2343
I20260809 18:49:28.440709 2118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:28.431971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:40569 (local address 127.12.202.254:38199)
0809 18:49:28.432068 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:28.432071 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:28.432291 (+ 220us) server_negotiation.cc:407] Connection header received
0809 18:49:28.432824 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:28.432826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:28.432840 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:28.432923 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:28.433435 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:28.433916 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:28.434872 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:28.435078 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:28.435163 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:28.437646 (+ 2483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:28.437648 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:28.437648 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:28.437656 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:28.439162 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:28.439599 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:28.439601 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:28.439601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:28.439665 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:28.440017 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:28.440018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:28.440019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:28.440154 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:28.440229 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:28.440547 (+ 318us) server_negotiation.cc:299] Negotiation successful
0809 18:49:28.440626 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 18:49:28.440855 2572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:28.431969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:38199 (local address 127.12.202.195:40569)
0809 18:49:28.432143 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:28.432186 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:28.432709 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:28.432973 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:28.432976 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:28.433148 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:28.433335 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:28.433339 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:28.434012 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:28.434013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:28.434779 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:28.434782 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:28.435198 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:28.435200 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:28.435326 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:28.435903 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:28.435916 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:28.437551 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:28.439250 (+ 1699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:28.439257 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:28.439258 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:28.439525 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:28.439750 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:28.439750 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:28.439751 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:28.439899 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:28.440230 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:28.440235 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:28.440405 (+ 170us) client_negotiation.cc:769] Sending connection context
0809 18:49:28.440508 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 18:49:28.440641 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":98,"threads_started":1}
I20260809 18:49:28.441550 2569 heartbeater.cc:347] Connected to a master server at 127.12.202.254:38199
I20260809 18:49:28.441664 2569 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:28.441867 2569 heartbeater.cc:511] Master 127.12.202.254:38199 requested a full tablet report, sending...
W20260809 18:49:28.442662 2569 heartbeater.cc:644] Failed to heartbeat to 127.12.202.254:38199 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 18:49:28.442739 2569 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:28.442816 2569 heartbeater.cc:511] Master 127.12.202.254:38199 requested a full tablet report, sending...
I20260809 18:49:28.443152 2569 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:28.443239 2569 heartbeater.cc:511] Master 127.12.202.254:38199 requested a full tablet report, sending...
W20260809 18:49:28.443557 2569 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 18:49:28.449383 2576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:28.440038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49220 (local address 127.12.202.254:38199)
0809 18:49:28.440470 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:28.440472 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:28.440478 (+ 6us) server_negotiation.cc:407] Connection header received
0809 18:49:28.440496 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:28.440496 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:28.440507 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:28.440558 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:28.442389 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:28.443007 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:28.444369 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:28.444836 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:28.444910 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:28.446382 (+ 1472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:28.446383 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:28.446384 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:28.446390 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:28.448169 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:28.448578 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:28.448579 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:28.448579 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:28.448651 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:28.448887 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:28.448888 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:28.448888 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:28.449007 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:28.449162 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:28.449212 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 18:49:28.449294 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":57,"threads_started":1}
Aug 09 18:49:28 dist-test-slave-45dx krb5kdc[32592](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786301368, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:29.080816 2110 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:29.080989 2110 heartbeater.cc:511] Master 127.12.202.254:38199 requested a full tablet report, sending...
I20260809 18:49:29.081388 1777 ts_manager.cc:194] Registered new tserver with Master: a31576859dd948faafb437c6f6b51a42 (127.12.202.193:44763)
I20260809 18:49:29.082449 1777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:55419
I20260809 18:49:29.268400 2338 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:29.268551 2338 heartbeater.cc:511] Master 127.12.202.254:38199 requested a full tablet report, sending...
I20260809 18:49:29.268949 1777 ts_manager.cc:194] Registered new tserver with Master: 7ace72368dcf4504b02b7afa8a883274 (127.12.202.194:40591)
I20260809 18:49:29.269496 1777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:43225
Aug 09 18:49:29 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301368, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
I20260809 18:49:29.443753 2569 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:29.443902 2569 heartbeater.cc:511] Master 127.12.202.254:38199 requested a full tablet report, sending...
I20260809 18:49:29.444243 1777 ts_manager.cc:194] Registered new tserver with Master: fb2dff7224144b03baf67987faac641b (127.12.202.195:43225)
I20260809 18:49:29.444770 1777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:40569
I20260809 18:49:29.449513 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:49:29.459069 2604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:29.450626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49224 (local address 127.12.202.254:38199)
0809 18:49:29.450904 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:29.450906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:29.451010 (+ 104us) server_negotiation.cc:407] Connection header received
0809 18:49:29.451107 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:29.451108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:29.451120 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:29.451162 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:29.451941 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.452780 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.453851 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.454194 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.454235 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:29.455919 (+ 1684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:29.455921 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:29.455921 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:29.455928 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:29.457879 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:29.458257 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:29.458258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:29.458259 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:29.458316 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:29.458513 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:29.458514 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:29.458514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:29.458630 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:29.458699 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:29.458892 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 18:49:29.458973 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":68,"threads_started":1}
I20260809 18:49:29.461658 1777 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49224:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:49:29.463835 1777 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:49:29.485957 2620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:29.475489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:44763 (local address 127.0.0.1:52526)
0809 18:49:29.476616 (+ 1127us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:29.476627 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:29.476668 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:29.477092 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:29.477096 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:29.477098 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:29.477193 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:29.477195 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.480593 (+ 3398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.480593 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:29.481996 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:29.482000 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.485650 (+ 3650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.485651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:29.485737 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:29.485753 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 18:49:29.485798 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 18:49:29.485858 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1108,"thread_start_us":66,"threads_started":1}
I20260809 18:49:29.486905 2622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:29.475590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52526 (local address 127.12.202.193:44763)
0809 18:49:29.476842 (+ 1252us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:29.476847 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:29.476856 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:49:29.476892 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:29.476894 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:29.476911 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:29.476982 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:29.477312 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.478723 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.482114 (+ 3391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.483473 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.486689 (+ 3216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:29.486760 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:29.486787 (+ 27us) server_negotiation.cc:299] Negotiation successful
0809 18:49:29.486827 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1211,"thread_start_us":60,"threads_started":1}
I20260809 18:49:29.487424 2616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:29.475225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:43225 (local address 127.0.0.1:50604)
0809 18:49:29.476369 (+ 1144us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:29.476414 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:29.476483 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:29.479070 (+ 2587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:29.479070 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:29.479073 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:29.479118 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:29.479120 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.483654 (+ 4534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.483655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:29.484747 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:29.484750 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.487200 (+ 2450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.487202 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:29.487286 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:29.487290 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:49:29.487320 (+ 30us) client_negotiation.cc:240] Negotiation successful
0809 18:49:29.487355 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1112,"mutex_wait_us":12,"thread_start_us":89,"threads_started":1}
I20260809 18:49:29.487967 2618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:29.475344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50604 (local address 127.12.202.195:43225)
0809 18:49:29.478888 (+ 3544us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:29.478892 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:29.478901 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:49:29.478935 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:29.478937 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:29.478965 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:29.479190 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:29.479287 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.483564 (+ 4277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.484848 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.485543 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.487768 (+ 2225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:29.487832 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:29.487857 (+ 25us) server_negotiation.cc:299] Negotiation successful
0809 18:49:29.487894 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3491,"thread_start_us":61,"threads_started":1}
I20260809 18:49:29.487861 2000 tablet_service.cc:1467] Processing CreateTablet for tablet 9f1584fc604042b398eb01cefb076769 (DEFAULT_TABLE table=test-table [id=2196ee20411747498a10d1b3d78de19b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:49:29.488283 2000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f1584fc604042b398eb01cefb076769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:29.488488 2623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:29.475677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:40591 (local address 127.0.0.1:53334)
0809 18:49:29.484403 (+ 8726us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:29.484415 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:29.484473 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:29.484834 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:29.484835 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:29.484837 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:29.484882 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:29.484883 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.486165 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.486166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:29.487296 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:29.487299 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.488224 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.488225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:29.488293 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:29.488337 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 18:49:29.488391 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 18:49:29.488426 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8703,"mutex_wait_us":1,"thread_start_us":80,"threads_started":1}
I20260809 18:49:29.488972 2458 tablet_service.cc:1467] Processing CreateTablet for tablet 9f1584fc604042b398eb01cefb076769 (DEFAULT_TABLE table=test-table [id=2196ee20411747498a10d1b3d78de19b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:49:29.489372 2458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f1584fc604042b398eb01cefb076769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:29.492458 2626 tablet_bootstrap.cc:492] T 9f1584fc604042b398eb01cefb076769 P a31576859dd948faafb437c6f6b51a42: Bootstrap starting.
I20260809 18:49:29.492496 2625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:29.475793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53334 (local address 127.12.202.194:40591)
0809 18:49:29.484591 (+ 8798us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:29.484595 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:29.484605 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:49:29.484639 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:29.484641 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:29.484656 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:29.484727 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:29.484954 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.486064 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.487397 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.488126 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.488203 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:29.488250 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:29.492363 (+ 4113us) server_negotiation.cc:299] Negotiation successful
0809 18:49:29.492413 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8763,"thread_start_us":206,"threads_started":1}
I20260809 18:49:29.493131 2210 tablet_service.cc:1467] Processing CreateTablet for tablet 9f1584fc604042b398eb01cefb076769 (DEFAULT_TABLE table=test-table [id=2196ee20411747498a10d1b3d78de19b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:49:29.493292 2626 tablet_bootstrap.cc:654] T 9f1584fc604042b398eb01cefb076769 P a31576859dd948faafb437c6f6b51a42: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:29.493495 2210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f1584fc604042b398eb01cefb076769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:29.493599 2626 log.cc:824] T 9f1584fc604042b398eb01cefb076769 P a31576859dd948faafb437c6f6b51a42: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:29.494352 2626 tablet_bootstrap.cc:492] T 9f1584fc604042b398eb01cefb076769 P a31576859dd948faafb437c6f6b51a42: No bootstrap required, opened a new log
I20260809 18:49:29.494411 2626 ts_tablet_manager.cc:1397] T 9f1584fc604042b398eb01cefb076769 P a31576859dd948faafb437c6f6b51a42: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:49:29.496762 2626 raft_consensus.cc:348] T 9f1584fc604042b398eb01cefb076769 P a31576859dd948faafb437c6f6b51a42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2dff7224144b03baf67987faac641b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43225 } } peers { permanent_uuid: "a31576859dd948faafb437c6f6b51a42" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44763 } } peers { permanent_uuid: "7ace72368dcf4504b02b7afa8a883274" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40591 } }
I20260809 18:49:29.496925 2626 raft_consensus.cc:374] T 9f1584fc604042b398eb01cefb076769 P a31576859dd948faafb437c6f6b51a42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:29.496963 2626 raft_consensus.cc:729] T 9f1584fc604042b398eb01cefb076769 P a31576859dd948faafb437c6f6b51a42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a31576859dd948faafb437c6f6b51a42, State: Initialized, Role: FOLLOWER
I20260809 18:49:29.497076 2626 consensus_queue.cc:260] T 9f1584fc604042b398eb01cefb076769 P a31576859dd948faafb437c6f6b51a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2dff7224144b03baf67987faac641b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43225 } } peers { permanent_uuid: "a31576859dd948faafb437c6f6b51a42" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44763 } } peers { permanent_uuid: "7ace72368dcf4504b02b7afa8a883274" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40591 } }
I20260809 18:49:29.497367 2626 ts_tablet_manager.cc:1428] T 9f1584fc604042b398eb01cefb076769 P a31576859dd948faafb437c6f6b51a42: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:49:29.497548 2110 heartbeater.cc:503] Master 127.12.202.254:38199 was elected leader, sending a full tablet report...
I20260809 18:49:29.497527 2630 tablet_bootstrap.cc:492] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274: Bootstrap starting.
I20260809 18:49:29.498162 2630 tablet_bootstrap.cc:654] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:29.498502 2630 log.cc:824] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:29.499019 2627 tablet_bootstrap.cc:492] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b: Bootstrap starting.
I20260809 18:49:29.499701 2627 tablet_bootstrap.cc:654] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:29.500077 2627 log.cc:824] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:29.501060 2627 tablet_bootstrap.cc:492] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b: No bootstrap required, opened a new log
I20260809 18:49:29.501127 2627 ts_tablet_manager.cc:1397] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:49:29.503746 2627 raft_consensus.cc:348] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2dff7224144b03baf67987faac641b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43225 } } peers { permanent_uuid: "a31576859dd948faafb437c6f6b51a42" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44763 } } peers { permanent_uuid: "7ace72368dcf4504b02b7afa8a883274" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40591 } }
I20260809 18:49:29.503911 2627 raft_consensus.cc:374] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:29.503949 2627 raft_consensus.cc:729] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb2dff7224144b03baf67987faac641b, State: Initialized, Role: FOLLOWER
I20260809 18:49:29.504523 2627 consensus_queue.cc:260] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2dff7224144b03baf67987faac641b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43225 } } peers { permanent_uuid: "a31576859dd948faafb437c6f6b51a42" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44763 } } peers { permanent_uuid: "7ace72368dcf4504b02b7afa8a883274" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40591 } }
I20260809 18:49:29.504932 2627 ts_tablet_manager.cc:1428] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260809 18:49:29.505116 2569 heartbeater.cc:503] Master 127.12.202.254:38199 was elected leader, sending a full tablet report...
I20260809 18:49:29.506929 2630 tablet_bootstrap.cc:492] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274: No bootstrap required, opened a new log
I20260809 18:49:29.507054 2630 ts_tablet_manager.cc:1397] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260809 18:49:29.509053 2630 raft_consensus.cc:348] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2dff7224144b03baf67987faac641b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43225 } } peers { permanent_uuid: "a31576859dd948faafb437c6f6b51a42" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44763 } } peers { permanent_uuid: "7ace72368dcf4504b02b7afa8a883274" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40591 } }
I20260809 18:49:29.509279 2630 raft_consensus.cc:374] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:29.509364 2630 raft_consensus.cc:729] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ace72368dcf4504b02b7afa8a883274, State: Initialized, Role: FOLLOWER
I20260809 18:49:29.509578 2630 consensus_queue.cc:260] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2dff7224144b03baf67987faac641b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43225 } } peers { permanent_uuid: "a31576859dd948faafb437c6f6b51a42" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44763 } } peers { permanent_uuid: "7ace72368dcf4504b02b7afa8a883274" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40591 } }
I20260809 18:49:29.509899 2630 ts_tablet_manager.cc:1428] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260809 18:49:29.510044 2338 heartbeater.cc:503] Master 127.12.202.254:38199 was elected leader, sending a full tablet report...
W20260809 18:49:29.557044 2114 tablet.cc:2369] T 9f1584fc604042b398eb01cefb076769 P a31576859dd948faafb437c6f6b51a42: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 18:49:29 dist-test-slave-45dx krb5kdc[32592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301368, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for HTTP/127.12.202.212@KRBTEST.COM
W20260809 18:49:29.682494 2570 tablet.cc:2369] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:49:29.748929 2340 tablet.cc:2369] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:49:29.834214 2639 raft_consensus.cc:482] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:49:29.834350 2639 raft_consensus.cc:504] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2dff7224144b03baf67987faac641b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43225 } } peers { permanent_uuid: "a31576859dd948faafb437c6f6b51a42" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44763 } } peers { permanent_uuid: "7ace72368dcf4504b02b7afa8a883274" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40591 } }
I20260809 18:49:29.834830 2639 leader_election.cc:288] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb2dff7224144b03baf67987faac641b (127.12.202.195:43225), a31576859dd948faafb437c6f6b51a42 (127.12.202.193:44763)
I20260809 18:49:29.838423 2618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:29.835112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:32923 (local address 127.12.202.195:43225)
0809 18:49:29.835171 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:29.835173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:29.835219 (+ 46us) server_negotiation.cc:407] Connection header received
0809 18:49:29.835396 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:29.835398 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:29.835408 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:29.835507 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:29.835719 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.836435 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.837666 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.838036 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.838123 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:29.838135 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:29.838308 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 18:49:29.838353 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 18:49:29.838462 2663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:29.834977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:43225 (local address 127.12.202.194:32923)
0809 18:49:29.835151 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:29.835163 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:29.835266 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:29.835514 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:29.835515 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:29.835518 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:29.835600 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:29.835602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.836520 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.836521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:29.837561 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:29.837563 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.838145 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.838146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:29.838239 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:29.838246 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 18:49:29.838302 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 18:49:29.838344 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":90,"threads_started":1}
I20260809 18:49:29.838539 2622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:29.835260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:52199 (local address 127.12.202.193:44763)
0809 18:49:29.835311 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:29.835313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:29.835321 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:49:29.835349 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:29.835350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:29.835378 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:29.835459 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:29.835629 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.836135 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.837619 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.838156 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.838233 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:29.838242 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:29.838416 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 18:49:29.838466 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 18:49:29.838724 2667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:29.835035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:44763 (local address 127.12.202.194:52199)
0809 18:49:29.835211 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:29.835220 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:29.835281 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:29.835479 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:29.835480 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:29.835482 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:29.835564 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:29.835566 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.836242 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.836244 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:29.837528 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:29.837531 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.838245 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.838246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:29.838330 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:29.838332 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:49:29.838617 (+ 285us) client_negotiation.cc:240] Negotiation successful
0809 18:49:29.838661 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":5,"thread_start_us":90,"threads_started":1}
I20260809 18:49:29.839102 2037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f1584fc604042b398eb01cefb076769" candidate_uuid: "7ace72368dcf4504b02b7afa8a883274" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a31576859dd948faafb437c6f6b51a42" is_pre_election: true
I20260809 18:49:29.839100 2481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f1584fc604042b398eb01cefb076769" candidate_uuid: "7ace72368dcf4504b02b7afa8a883274" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb2dff7224144b03baf67987faac641b" is_pre_election: true
I20260809 18:49:29.839267 2037 raft_consensus.cc:2454] T 9f1584fc604042b398eb01cefb076769 P a31576859dd948faafb437c6f6b51a42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ace72368dcf4504b02b7afa8a883274 in term 0.
I20260809 18:49:29.839265 2481 raft_consensus.cc:2454] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ace72368dcf4504b02b7afa8a883274 in term 0.
I20260809 18:49:29.839499 2156 leader_election.cc:302] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ace72368dcf4504b02b7afa8a883274, fb2dff7224144b03baf67987faac641b; no voters:
I20260809 18:49:29.839655 2639 raft_consensus.cc:2781] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:49:29.839705 2639 raft_consensus.cc:482] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:49:29.839726 2639 raft_consensus.cc:3037] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:29.840675 2639 raft_consensus.cc:504] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2dff7224144b03baf67987faac641b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43225 } } peers { permanent_uuid: "a31576859dd948faafb437c6f6b51a42" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44763 } } peers { permanent_uuid: "7ace72368dcf4504b02b7afa8a883274" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40591 } }
I20260809 18:49:29.840807 2639 leader_election.cc:288] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [CANDIDATE]: Term 1 election: Requested vote from peers fb2dff7224144b03baf67987faac641b (127.12.202.195:43225), a31576859dd948faafb437c6f6b51a42 (127.12.202.193:44763)
I20260809 18:49:29.841012 2481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f1584fc604042b398eb01cefb076769" candidate_uuid: "7ace72368dcf4504b02b7afa8a883274" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb2dff7224144b03baf67987faac641b"
I20260809 18:49:29.841039 2037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f1584fc604042b398eb01cefb076769" candidate_uuid: "7ace72368dcf4504b02b7afa8a883274" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a31576859dd948faafb437c6f6b51a42"
I20260809 18:49:29.841100 2037 raft_consensus.cc:3037] T 9f1584fc604042b398eb01cefb076769 P a31576859dd948faafb437c6f6b51a42 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:29.841099 2481 raft_consensus.cc:3037] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:29.842084 2037 raft_consensus.cc:2454] T 9f1584fc604042b398eb01cefb076769 P a31576859dd948faafb437c6f6b51a42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ace72368dcf4504b02b7afa8a883274 in term 1.
I20260809 18:49:29.842084 2481 raft_consensus.cc:2454] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ace72368dcf4504b02b7afa8a883274 in term 1.
I20260809 18:49:29.842309 2154 leader_election.cc:302] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ace72368dcf4504b02b7afa8a883274, a31576859dd948faafb437c6f6b51a42; no voters:
I20260809 18:49:29.842427 2639 raft_consensus.cc:2781] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:49:29.842597 2639 raft_consensus.cc:686] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [term 1 LEADER]: Becoming Leader. State: Replica: 7ace72368dcf4504b02b7afa8a883274, State: Running, Role: LEADER
I20260809 18:49:29.842691 2639 consensus_queue.cc:237] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2dff7224144b03baf67987faac641b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43225 } } peers { permanent_uuid: "a31576859dd948faafb437c6f6b51a42" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44763 } } peers { permanent_uuid: "7ace72368dcf4504b02b7afa8a883274" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40591 } }
I20260809 18:49:29.843556 1777 catalog_manager.cc:5495] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ace72368dcf4504b02b7afa8a883274 (127.12.202.194). New cstate: current_term: 1 leader_uuid: "7ace72368dcf4504b02b7afa8a883274" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2dff7224144b03baf67987faac641b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a31576859dd948faafb437c6f6b51a42" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ace72368dcf4504b02b7afa8a883274" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 40591 } health_report { overall_health: HEALTHY } } }
I20260809 18:49:29.920658 2625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:29.918065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53340 (local address 127.12.202.194:40591)
0809 18:49:29.918130 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:29.918132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:29.918140 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:49:29.918186 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:29.918187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:29.918205 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:29.918287 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:49:29.918442 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.918961 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.919777 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:29.920012 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:29.920086 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:29.920287 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:49:29.920418 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:49:29.920520 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:29.920541 (+ 21us) server_negotiation.cc:299] Negotiation successful
0809 18:49:29.920563 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:49:29.922719 2481 raft_consensus.cc:1261] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b [term 1 FOLLOWER]: Refusing update from remote peer 7ace72368dcf4504b02b7afa8a883274: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:49:29.922698 2037 raft_consensus.cc:1261] T 9f1584fc604042b398eb01cefb076769 P a31576859dd948faafb437c6f6b51a42 [term 1 FOLLOWER]: Refusing update from remote peer 7ace72368dcf4504b02b7afa8a883274: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:49:29.923091 2669 consensus_queue.cc:1035] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb2dff7224144b03baf67987faac641b" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:49:29.923283 2669 consensus_queue.cc:1035] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a31576859dd948faafb437c6f6b51a42" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:49:29.925760 2674 mvcc.cc:205] Tried to move back new op lower bound from 7316690411200409600 to 7316690410876231680. Current Snapshot: MvccSnapshot[applied={T|T < 7316690411200409600}]
I20260809 18:49:29.926322 2679 mvcc.cc:205] Tried to move back new op lower bound from 7316690411200409600 to 7316690410876231680. Current Snapshot: MvccSnapshot[applied={T|T < 7316690411200409600}]
I20260809 18:49:29.926891 2675 mvcc.cc:205] Tried to move back new op lower bound from 7316690411200409600 to 7316690410876231680. Current Snapshot: MvccSnapshot[applied={T|T < 7316690411200409600}]
I20260809 18:49:29.928860 1776 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:49:29.928984 1776 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:49:29.929785 1776 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 459d89ff8df14aa5a294e8b6207eaab6: Sending DeleteTablet for 3 replicas of tablet 9f1584fc604042b398eb01cefb076769
I20260809 18:49:29.930236 2458 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f1584fc604042b398eb01cefb076769 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:49:29 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:50604
I20260809 18:49:29.930236 2000 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f1584fc604042b398eb01cefb076769 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:49:29 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:52526
I20260809 18:49:29.930450 2210 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f1584fc604042b398eb01cefb076769 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:49:29 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:53334
I20260809 18:49:29.930676 2690 tablet_replica.cc:330] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274: stopping tablet replica
I20260809 18:49:29.930768 2690 raft_consensus.cc:2229] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:49:29.930915 2690 raft_consensus.cc:2258] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:49:29.931133 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 1833
I20260809 18:49:29.931383 2690 ts_tablet_manager.cc:1905] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:49:29.933336 2690 ts_tablet_manager.cc:1918] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:49:29.933410 2690 log.cc:1196] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/9f1584fc604042b398eb01cefb076769
I20260809 18:49:29.933717 2690 ts_tablet_manager.cc:1939] T 9f1584fc604042b398eb01cefb076769 P 7ace72368dcf4504b02b7afa8a883274: Deleting consensus metadata
I20260809 18:49:29.934145 1751 catalog_manager.cc:4841] TS 7ace72368dcf4504b02b7afa8a883274 (127.12.202.194:40591): tablet 9f1584fc604042b398eb01cefb076769 (table test-table [id=2196ee20411747498a10d1b3d78de19b]) successfully deleted
I20260809 18:49:29.944015 2688 tablet_replica.cc:330] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b: stopping tablet replica
I20260809 18:49:29.944983 2688 raft_consensus.cc:2229] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:49:29.945181 2688 raft_consensus.cc:2258] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:49:29.945706 2688 ts_tablet_manager.cc:1905] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:49:29.947326 2688 ts_tablet_manager.cc:1918] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:49:29.947443 2688 log.cc:1196] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/9f1584fc604042b398eb01cefb076769
I20260809 18:49:29.947749 2688 ts_tablet_manager.cc:1939] T 9f1584fc604042b398eb01cefb076769 P fb2dff7224144b03baf67987faac641b: Deleting consensus metadata
I20260809 18:49:29.948239 1754 catalog_manager.cc:4841] TS fb2dff7224144b03baf67987faac641b (127.12.202.195:43225): tablet 9f1584fc604042b398eb01cefb076769 (table test-table [id=2196ee20411747498a10d1b3d78de19b]) successfully deleted
W20260809 18:49:29.950198 1752 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.202.193:44763 (error 108)
I20260809 18:49:29.950932 2623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:29.950790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:44763 (local address 127.0.0.1:52540)
0809 18:49:29.950851 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:29.950893 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:44763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 18:49:29.950991 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 2119
W20260809 18:49:29.957245 1752 catalog_manager.cc:4584] TS a31576859dd948faafb437c6f6b51a42 (127.12.202.193:44763): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9f1584fc604042b398eb01cefb076769: Network error: Client connection negotiation failed: client connection to 127.12.202.193:44763: connect: Connection refused (error 111)
I20260809 18:49:29.961445 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 2343
I20260809 18:49:29.974496 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 1729
I20260809 18:49:29.996773 13099 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 18:49:30.344735 13099 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 18:49:30.344848 13099 mini_ranger.cc:66] Stopping Ranger...
I20260809 18:49:30.689214 13099 mini_ranger.cc:68] Stopped Ranger
2026-08-09 18:49:30.689 UTC [32641] LOG: received smart shutdown request
2026-08-09 18:49:30.693 UTC [32641] LOG: background worker "logical replication launcher" (PID 32654) exited with exit code 1
2026-08-09 18:49:30.694 UTC [32646] LOG: shutting down
2026-08-09 18:49:30.843 UTC [32641] LOG: database system is shut down
2026-08-09T18:49:30Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49068 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:49:31 dist-test-slave-45dx krb5kdc[2705](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:49:31 dist-test-slave-45dx krb5kdc[2705](info): set up 2 sockets
Aug 09 18:49:31 dist-test-slave-45dx krb5kdc[2705](info): commencing operation
krb5kdc: starting...
W20260809 18:49:32.217012 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:49:32 dist-test-slave-45dx krb5kdc[2705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301372, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:49:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:49:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:49:32.344895 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:43711
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:37773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:43711,127.12.202.253:35557,127.12.202.252:45057
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:49:32.425702 2727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:32.425940 2727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:32.425974 2727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:32.427068 2727 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:49:32.427136 2727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:32.427160 2727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:32.427179 2727 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:49:32.427207 2727 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:49:32.428618 2727 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:37773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:43711,127.12.202.253:35557,127.12.202.252:45057
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:43711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:32.428870 2727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:32.429080 2727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:32.434052 2737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:32.434064 2739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:32.434319 2727 server_base.cc:1034] running on GCE node
W20260809 18:49:32.434064 2746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:32.434641 2727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:32.434947 2727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:32.436137 2727 hybrid_clock.cc:648] HybridClock initialized: now 1786301372436130 us; error 38 us; skew 500 ppm
Aug 09 18:49:32 dist-test-slave-45dx krb5kdc[2705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301372, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:32.442790 2727 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:49:32.443235 2727 webserver.cc:460] Webserver started at http://127.12.202.254:37349/ using document root <none> and password file <none>
I20260809 18:49:32.443419 2727 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:32.443461 2727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:32.443547 2727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:49:32.444607 2727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "5f299a4c922a4fa48451a4e44907741a"
format_stamp: "Formatted at 2026-08-09 18:49:32 on dist-test-slave-45dx"
server_key: "ce481197b6d9024c24a4e98a4006e247"
server_key_iv: "a56c72dedfb1c9ac0cf1ba28fae2c2ff"
server_key_version: "encryptionkey@0"
I20260809 18:49:32.444921 2727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "5f299a4c922a4fa48451a4e44907741a"
format_stamp: "Formatted at 2026-08-09 18:49:32 on dist-test-slave-45dx"
server_key: "ce481197b6d9024c24a4e98a4006e247"
server_key_iv: "a56c72dedfb1c9ac0cf1ba28fae2c2ff"
server_key_version: "encryptionkey@0"
I20260809 18:49:32.446223 2727 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:49:32.446990 2759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:32.447214 2727 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:49:32.447311 2727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "5f299a4c922a4fa48451a4e44907741a"
format_stamp: "Formatted at 2026-08-09 18:49:32 on dist-test-slave-45dx"
server_key: "ce481197b6d9024c24a4e98a4006e247"
server_key_iv: "a56c72dedfb1c9ac0cf1ba28fae2c2ff"
server_key_version: "encryptionkey@0"
I20260809 18:49:32.447373 2727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:32.458962 2727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:32.460969 2727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:32.461081 2727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:32.465063 2727 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:43711
I20260809 18:49:32.465114 2838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:43711 every 8 connection(s)
I20260809 18:49:32.465466 2727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:49:32.466351 2840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:32.467907 2840 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:49:32.470724 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 2727
I20260809 18:49:32.470845 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:49:32.471025 13099 external_mini_cluster.cc:1428] Setting key e4623bbd9cf328660e8ec3a06a2cc86d
Aug 09 18:49:32 dist-test-slave-45dx krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301372, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:32.477782 2843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.468783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39468 (local address 127.12.202.254:43711)
0809 18:49:32.468911 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:32.468921 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:32.468949 (+ 28us) server_negotiation.cc:407] Connection header received
0809 18:49:32.469383 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:32.469385 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:32.469401 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:32.469474 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:32.469977 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.470723 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.471648 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.471955 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.472069 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.474494 (+ 2425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:32.474500 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:32.474501 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:32.474506 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:32.476090 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.476609 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.476611 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.476611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.476689 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.476961 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.476962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.476962 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.477216 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:32.477280 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:32.477512 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 18:49:32.477617 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":98,"thread_start_us":65,"threads_started":1}
I20260809 18:49:32.477880 2842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.468636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43711 (local address 127.0.0.1:39468)
0809 18:49:32.468784 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.468817 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:32.469244 (+ 427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:32.469502 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:32.469504 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:32.469741 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:32.469896 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:32.469900 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.470826 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.470827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:32.471562 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:32.471565 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.472042 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.472043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:32.472104 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.472679 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:32.472689 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:32.474410 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:32.476174 (+ 1764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:32.476183 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:32.476185 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:32.476527 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:32.476762 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:32.476763 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:32.476763 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:32.476892 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:32.477294 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:32.477300 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:32.477380 (+ 80us) client_negotiation.cc:769] Sending connection context
0809 18:49:32.477489 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 18:49:32.477721 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":77,"thread_start_us":68,"threads_started":1}
I20260809 18:49:32.478660 2840 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:49:32.479033 2842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.478881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:35557 (local address 127.0.0.1:45094)
0809 18:49:32.478932 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.479000 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.253:35557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 18:49:32.479190 2761 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.202.253:35557: connect: Connection refused (error 111)
I20260809 18:49:32.479686 2842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.479563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:35557 (local address 127.0.0.1:45096)
0809 18:49:32.479618 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.479657 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.253:35557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 18:49:32.479842 2840 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.253:35557: Network error: Client connection negotiation failed: client connection to 127.12.202.253:35557: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.12.202.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.253.keytab.
Entry for principal kudu/127.12.202.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.253.keytab.
I20260809 18:49:32.498673 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.253:35557
--webserver_interface=127.12.202.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.253.keytab
--principal=kudu/127.12.202.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:37773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:43711,127.12.202.253:35557,127.12.202.252:45057
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:49:32.529069 2840 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } attempt: 1
I20260809 18:49:32.529652 2842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.529489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:35557 (local address 127.0.0.1:45108)
0809 18:49:32.529559 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.529610 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.253:35557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 18:49:32.530099 2842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.529996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:35557 (local address 127.0.0.1:45116)
0809 18:49:32.530043 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.530074 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.253:35557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 18:49:32.530226 2840 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.253:35557: Network error: Client connection negotiation failed: client connection to 127.12.202.253:35557: connect: Connection refused (error 111)
W20260809 18:49:32.582166 2852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:32.582362 2852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:32.582386 2852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:32.583591 2852 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:49:32.583632 2852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:32.583647 2852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:32.583680 2852 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:49:32.583706 2852 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:49:32.585179 2852 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:37773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:43711,127.12.202.253:35557,127.12.202.252:45057
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.253.keytab
--principal=kudu/127.12.202.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.253:35557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.202.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:32.585428 2852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:32.585649 2852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:32.590624 2857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:32.590624 2863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:32.590641 2852 server_base.cc:1034] running on GCE node
W20260809 18:49:32.590641 2859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:32.591100 2852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:32.591403 2852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:32.592568 2852 hybrid_clock.cc:648] HybridClock initialized: now 1786301372592555 us; error 48 us; skew 500 ppm
Aug 09 18:49:32 dist-test-slave-45dx krb5kdc[2705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301372, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:32.595134 2852 init.cc:377] Logged in from keytab as kudu/127.12.202.253@KRBTEST.COM (short username kudu)
I20260809 18:49:32.595636 2852 webserver.cc:460] Webserver started at http://127.12.202.253:34673/ using document root <none> and password file <none>
I20260809 18:49:32.595844 2852 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:32.595892 2852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:32.595980 2852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:49:32.597000 2852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-1/data/instance:
uuid: "4e0e4f1aa17643eebf5d570850e65c1a"
format_stamp: "Formatted at 2026-08-09 18:49:32 on dist-test-slave-45dx"
server_key: "f3075362258cf93797acf683d075e144"
server_key_iv: "abfbdd0bba204781dad218a1a9fbeb86"
server_key_version: "encryptionkey@0"
I20260809 18:49:32.597304 2852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-1/wal/instance:
uuid: "4e0e4f1aa17643eebf5d570850e65c1a"
format_stamp: "Formatted at 2026-08-09 18:49:32 on dist-test-slave-45dx"
server_key: "f3075362258cf93797acf683d075e144"
server_key_iv: "abfbdd0bba204781dad218a1a9fbeb86"
server_key_version: "encryptionkey@0"
I20260809 18:49:32.598419 2840 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } attempt: 2
I20260809 18:49:32.598650 2852 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:49:32.598834 2842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.598681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:35557 (local address 127.0.0.1:45124)
0809 18:49:32.598753 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.598797 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.253:35557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 18:49:32.599186 2842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.599072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:35557 (local address 127.0.0.1:45132)
0809 18:49:32.599125 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.599158 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.253:35557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 18:49:32.599323 2840 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.253:35557: Network error: Client connection negotiation failed: client connection to 127.12.202.253:35557: connect: Connection refused (error 111)
I20260809 18:49:32.599563 2873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:32.599745 2852 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:49:32.599848 2852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-1/wal
uuid: "4e0e4f1aa17643eebf5d570850e65c1a"
format_stamp: "Formatted at 2026-08-09 18:49:32 on dist-test-slave-45dx"
server_key: "f3075362258cf93797acf683d075e144"
server_key_iv: "abfbdd0bba204781dad218a1a9fbeb86"
server_key_version: "encryptionkey@0"
I20260809 18:49:32.599937 2852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:32.609994 2852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:32.612421 2852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:32.612589 2852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:32.616418 2852 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.253:35557
I20260809 18:49:32.616480 2960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.253:35557 every 8 connection(s)
I20260809 18:49:32.616835 2852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-1/data/info.pb
I20260809 18:49:32.617758 2961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:32.619277 2961 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:49:32.623910 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 2852
I20260809 18:49:32.624070 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-1/wal/instance
I20260809 18:49:32.624281 13099 external_mini_cluster.cc:1428] Setting key d92d79480fa6d31dbd86dca9fa5fcb6e
Aug 09 18:49:32 dist-test-slave-45dx krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301372, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.253@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:32.628450 2843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.620031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39484 (local address 127.12.202.254:43711)
0809 18:49:32.620100 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:32.620102 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:32.620333 (+ 231us) server_negotiation.cc:407] Connection header received
0809 18:49:32.620836 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:32.620837 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:32.620849 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:32.620919 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:32.621495 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.621992 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.622933 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.623117 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.623168 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.625558 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:32.625560 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:32.625560 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:32.625574 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:32.626999 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.627404 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.627405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.627405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.627458 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.627730 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.627730 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.627731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.627867 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:32.627951 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:32.628235 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 18:49:32.628359 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 18:49:32.628614 2964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.620009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43711 (local address 127.0.0.1:39484)
0809 18:49:32.620186 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.620229 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:32.620749 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:32.620970 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:32.620973 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:32.621222 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:32.621418 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:32.621422 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.622075 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.622076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:32.622856 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:32.622858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.623191 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.623192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:32.623290 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.623785 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:32.623794 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:32.625449 (+ 1655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:32.627082 (+ 1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:32.627090 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:32.627092 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:32.627336 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:32.627536 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:32.627537 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:32.627537 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:32.627652 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:32.627956 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:32.627965 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:32.628098 (+ 133us) client_negotiation.cc:769] Sending connection context
0809 18:49:32.628202 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 18:49:32.628377 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":94,"threads_started":1}
I20260809 18:49:32.629225 2961 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:49:32 dist-test-slave-45dx krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301372, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.253@KRBTEST.COM for kudu/127.12.202.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.202.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.252@KRBTEST.COM" created.
I20260809 18:49:32.637020 2964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.629515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:35557 (local address 127.0.0.1:45142)
0809 18:49:32.629570 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.629582 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:32.629647 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:32.629869 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:32.629870 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:32.630032 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:32.630098 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:32.630099 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.631097 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.631098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:32.631575 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:32.631577 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.632033 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.632035 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:32.632107 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.632600 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:32.632605 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:32.633808 (+ 1203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:32.635793 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:32.635793 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:32.635794 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:32.635966 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:32.636235 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:32.636235 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:32.636236 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:32.636321 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:32.636678 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:32.636679 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:32.636730 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 18:49:32.636805 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 18:49:32.636912 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 18:49:32.637089 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.629551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45142 (local address 127.12.202.253:35557)
0809 18:49:32.629724 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:32.629729 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:32.629747 (+ 18us) server_negotiation.cc:407] Connection header received
0809 18:49:32.629774 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:32.629775 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:32.629786 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:32.629845 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:32.630177 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.631001 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.631657 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.631947 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.632025 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.633893 (+ 1868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:32.633901 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:32.633902 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:32.633909 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:32.635717 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.636051 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.636053 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.636054 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.636135 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.636388 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.636389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.636389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.636592 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:32.636684 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:32.636842 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 18:49:32.636966 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":145,"thread_start_us":118,"threads_started":1}
I20260809 18:49:32.638010 2961 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:49:32.638434 2964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.638244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:45057 (local address 127.0.0.1:39408)
0809 18:49:32.638304 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.638384 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:45057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260809 18:49:32.638572 2879 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.202.252:45057: connect: Connection refused (error 111)
I20260809 18:49:32.639047 2964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.638950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:45057 (local address 127.0.0.1:39416)
0809 18:49:32.639000 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.639025 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:45057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 18:49:32.639156 2961 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.252:45057: Network error: Client connection negotiation failed: client connection to 127.12.202.252:45057: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.252.keytab.
Entry for principal kudu/127.12.202.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.252.keytab.
I20260809 18:49:32.650852 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.252:45057
--webserver_interface=127.12.202.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.252.keytab
--principal=kudu/127.12.202.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:37773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:43711,127.12.202.253:35557,127.12.202.252:45057
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:49:32.688392 2961 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } attempt: 1
I20260809 18:49:32.688937 2964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.688789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:45057 (local address 127.0.0.1:39418)
0809 18:49:32.688860 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.688905 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:45057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 18:49:32.689343 2964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.689254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:45057 (local address 127.0.0.1:39428)
0809 18:49:32.689296 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.689323 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:45057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 18:49:32.689462 2961 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.252:45057: Network error: Client connection negotiation failed: client connection to 127.12.202.252:45057: connect: Connection refused (error 111)
I20260809 18:49:32.690491 2840 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } attempt: 3
Aug 09 18:49:32 dist-test-slave-45dx krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301372, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for kudu/127.12.202.253@KRBTEST.COM
I20260809 18:49:32.697508 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.690858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45150 (local address 127.12.202.253:35557)
0809 18:49:32.690923 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:32.690925 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:32.690937 (+ 12us) server_negotiation.cc:407] Connection header received
0809 18:49:32.691002 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:32.691003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:32.691015 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:32.691073 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:32.691418 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.691939 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.692662 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.692888 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.692969 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.694871 (+ 1902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:32.694873 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:32.694873 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:32.694881 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:32.696345 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.696703 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.696704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.696705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.696769 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.696978 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.696979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.696979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.697099 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:32.697172 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:32.697334 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 18:49:32.697416 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 18:49:32.697513 2842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.690804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:35557 (local address 127.0.0.1:45150)
0809 18:49:32.690850 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.690862 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:32.690941 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:32.691078 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:32.691079 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:32.691249 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:32.691322 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:32.691324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.692028 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.692030 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:32.692572 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:32.692573 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.692967 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.692968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:32.693061 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.693558 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:32.693564 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:32.694781 (+ 1217us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:32.696447 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:32.696448 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:32.696448 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:32.696629 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:32.696838 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:32.696839 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:32.696839 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:32.696906 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:32.697179 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:32.697180 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:32.697224 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 18:49:32.697309 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 18:49:32.697416 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260809 18:49:32.697865 2840 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:49:32.698207 2842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.698106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:45057 (local address 127.0.0.1:39432)
0809 18:49:32.698156 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.698183 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:45057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 18:49:32.698549 2842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.698491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:45057 (local address 127.0.0.1:39446)
0809 18:49:32.698516 (+ 25us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.698537 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:45057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260809 18:49:32.698648 2840 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.252:45057: Network error: Client connection negotiation failed: client connection to 127.12.202.252:45057: connect: Connection refused (error 111)
I20260809 18:49:32.729790 2840 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } attempt: 1
I20260809 18:49:32.730290 2842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.730156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:45057 (local address 127.0.0.1:39448)
0809 18:49:32.730224 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.730264 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:45057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 18:49:32.730695 2842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.730614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:45057 (local address 127.0.0.1:39460)
0809 18:49:32.730654 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.730679 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:45057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 18:49:32.730806 2840 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.252:45057: Network error: Client connection negotiation failed: client connection to 127.12.202.252:45057: connect: Connection refused (error 111)
W20260809 18:49:32.734887 2972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:32.735069 2972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:32.735090 2972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:32.736346 2972 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:49:32.736398 2972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:32.736414 2972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:32.736447 2972 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:49:32.736474 2972 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:49:32.737968 2972 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:37773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:43711,127.12.202.253:35557,127.12.202.252:45057
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.252.keytab
--principal=kudu/127.12.202.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.252:45057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.202.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:32.738229 2972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:32.738476 2972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:32.743451 2980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:32.743451 2984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:32.743479 2981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:32.743479 2972 server_base.cc:1034] running on GCE node
I20260809 18:49:32.743976 2972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:32.744283 2972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:32.745481 2972 hybrid_clock.cc:648] HybridClock initialized: now 1786301372745472 us; error 27 us; skew 500 ppm
Aug 09 18:49:32 dist-test-slave-45dx krb5kdc[2705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301372, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:32.748020 2972 init.cc:377] Logged in from keytab as kudu/127.12.202.252@KRBTEST.COM (short username kudu)
I20260809 18:49:32.748545 2972 webserver.cc:460] Webserver started at http://127.12.202.252:45757/ using document root <none> and password file <none>
I20260809 18:49:32.748780 2972 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:32.748849 2972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:32.749009 2972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:49:32.750059 2972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-2/data/instance:
uuid: "e05e69afed2b41b18871175e63d7d49e"
format_stamp: "Formatted at 2026-08-09 18:49:32 on dist-test-slave-45dx"
server_key: "dcbc93780d3522452eda87599730e8e9"
server_key_iv: "78e273c4cf1f094b5058de138c8d7261"
server_key_version: "encryptionkey@0"
I20260809 18:49:32.750437 2972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-2/wal/instance:
uuid: "e05e69afed2b41b18871175e63d7d49e"
format_stamp: "Formatted at 2026-08-09 18:49:32 on dist-test-slave-45dx"
server_key: "dcbc93780d3522452eda87599730e8e9"
server_key_iv: "78e273c4cf1f094b5058de138c8d7261"
server_key_version: "encryptionkey@0"
I20260809 18:49:32.751732 2972 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 18:49:32.752626 2996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:32.752804 2972 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:49:32.752909 2972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-2/wal
uuid: "e05e69afed2b41b18871175e63d7d49e"
format_stamp: "Formatted at 2026-08-09 18:49:32 on dist-test-slave-45dx"
server_key: "dcbc93780d3522452eda87599730e8e9"
server_key_iv: "78e273c4cf1f094b5058de138c8d7261"
server_key_version: "encryptionkey@0"
I20260809 18:49:32.752995 2972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:32.757611 2961 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } attempt: 2
I20260809 18:49:32.758028 2964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.757900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:45057 (local address 127.0.0.1:39466)
0809 18:49:32.757960 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.757999 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:45057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 18:49:32.758421 2964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.758314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:45057 (local address 127.0.0.1:39472)
0809 18:49:32.758365 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.758401 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:45057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 18:49:32.758519 2961 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.252:45057: Network error: Client connection negotiation failed: client connection to 127.12.202.252:45057: connect: Connection refused (error 111)
I20260809 18:49:32.761461 2972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:32.763258 2972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:32.763427 2972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:32.767647 2972 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.252:45057
I20260809 18:49:32.767679 3083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.252:45057 every 8 connection(s)
I20260809 18:49:32.768102 2972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-2/data/info.pb
I20260809 18:49:32.769101 3084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:32.770632 3084 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:49:32.776036 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 2972
I20260809 18:49:32.776160 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786301184679835-13099-0/minicluster-data/master-2/wal/instance
I20260809 18:49:32.776419 13099 external_mini_cluster.cc:1428] Setting key f696b952271f086f04f0ad73bd1ac2c3
Aug 09 18:49:32 dist-test-slave-45dx krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301372, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.252@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:32.780009 2843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.771421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39488 (local address 127.12.202.254:43711)
0809 18:49:32.771526 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:32.771529 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:32.771698 (+ 169us) server_negotiation.cc:407] Connection header received
0809 18:49:32.772230 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:32.772232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:32.772246 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:32.772298 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:32.772959 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.773445 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.774447 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.774655 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.774765 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.777076 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:32.777077 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:32.777078 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:32.777086 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:32.778638 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.779093 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.779094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.779094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.779164 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.779400 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.779401 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.779402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.779537 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:32.779607 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:32.779875 (+ 268us) server_negotiation.cc:299] Negotiation successful
0809 18:49:32.779945 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 18:49:32.780198 3089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.771305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43711 (local address 127.0.0.1:39488)
0809 18:49:32.771560 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.771607 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:32.772107 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:32.772398 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:32.772401 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:32.772659 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:32.772854 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:32.772858 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.773546 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.773547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:32.774330 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:32.774332 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.774772 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.774774 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:32.774904 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.775403 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:32.775411 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:32.776978 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:32.778722 (+ 1744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:32.778727 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:32.778729 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:32.779021 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:32.779235 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:32.779235 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:32.779236 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:32.779334 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:32.779601 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:32.779605 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:32.779712 (+ 107us) client_negotiation.cc:769] Sending connection context
0809 18:49:32.779838 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 18:49:32.779985 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":104,"threads_started":1}
I20260809 18:49:32.780983 3084 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:49:32 dist-test-slave-45dx krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301372, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.252@KRBTEST.COM
Aug 09 18:49:32 dist-test-slave-45dx krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301372, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.252@KRBTEST.COM for kudu/127.12.202.253@KRBTEST.COM
I20260809 18:49:32.785889 3095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.776807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39474 (local address 127.12.202.252:45057)
0809 18:49:32.777104 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:32.777107 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:32.777120 (+ 13us) server_negotiation.cc:407] Connection header received
0809 18:49:32.777136 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:32.777137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:32.777147 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:32.777197 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:32.778000 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.778786 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.779773 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.780188 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.780265 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.782904 (+ 2639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:32.782912 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:32.782912 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:32.782918 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:32.784661 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.785030 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.785033 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.785033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.785099 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.785290 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.785291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.785291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.785466 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:32.785608 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:32.785662 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 18:49:32.785756 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":85,"threads_started":1}
I20260809 18:49:32.788553 3089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.781238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:35557 (local address 127.0.0.1:45152)
0809 18:49:32.781293 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.781303 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:32.781341 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:32.781512 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:32.781512 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:32.781621 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:32.781664 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:32.781665 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.782358 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.782360 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:32.783063 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:32.783066 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.783838 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.783839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:32.783916 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.784329 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:32.784334 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:32.785751 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:32.787563 (+ 1812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:32.787564 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:32.787565 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:32.787730 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:32.787937 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:32.787938 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:32.787938 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:32.787994 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:32.788261 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:32.788262 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:32.788323 (+ 61us) client_negotiation.cc:769] Sending connection context
0809 18:49:32.788381 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 18:49:32.788468 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 18:49:32.788573 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.781331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45152 (local address 127.12.202.253:35557)
0809 18:49:32.781382 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:32.781384 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:32.781394 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:49:32.781421 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:32.781421 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:32.781434 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:32.781512 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:32.781750 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.782278 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.783434 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.783758 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.783828 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.785822 (+ 1994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:32.785824 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:32.785824 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:32.785833 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:32.787479 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.787803 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.787804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.787805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.787863 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.788075 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.788076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.788077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.788187 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:32.788256 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:32.788415 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 18:49:32.788487 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 18:49:32.788924 3084 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:49:32 dist-test-slave-45dx krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301372, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
Aug 09 18:49:32 dist-test-slave-45dx krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301372, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.252@KRBTEST.COM for kudu/127.12.202.252@KRBTEST.COM
I20260809 18:49:32.794030 2843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.787014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39494 (local address 127.12.202.254:43711)
0809 18:49:32.787052 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:32.787053 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:32.787060 (+ 7us) server_negotiation.cc:407] Connection header received
0809 18:49:32.787075 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:32.787075 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:32.787082 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:32.787143 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:32.787590 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.788001 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.788833 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.789116 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.789157 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.791360 (+ 2203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:32.791362 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:32.791362 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:32.791369 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:32.792760 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.793131 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.793132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.793132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.793189 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.793414 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.793415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.793415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.793575 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:32.793799 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:32.793846 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 18:49:32.793935 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 18:49:32.795747 3089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.789135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:45057 (local address 127.0.0.1:39486)
0809 18:49:32.789180 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.789189 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:32.789218 (+ 29us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:32.789343 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:32.789344 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:32.789487 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:32.789513 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:32.789514 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.790178 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.790179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:32.790788 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:32.790790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.791193 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.791194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:32.791241 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.791593 (+ 352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:32.791598 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:32.792890 (+ 1292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:32.794745 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:32.794746 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:32.794746 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:32.794930 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:32.795138 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:32.795139 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:32.795139 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:32.795191 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:32.795400 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:32.795401 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:32.795450 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 18:49:32.795535 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 18:49:32.795635 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 18:49:32.795778 3095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.789181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39486 (local address 127.12.202.252:45057)
0809 18:49:32.789214 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:32.789215 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:32.789223 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:49:32.789272 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:32.789273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:32.789280 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:32.789324 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:32.789607 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.790095 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.790882 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.791124 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.791195 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.792981 (+ 1786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:32.792982 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:32.792982 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:32.792988 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:32.794669 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.794997 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.794998 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.794998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.795070 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.795235 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.795235 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.795235 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.795324 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:32.795376 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:32.795561 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 18:49:32.795680 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":15}
I20260809 18:49:32.797830 3084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e: Bootstrap starting.
I20260809 18:49:32.798750 3084 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:32.799096 3084 log.cc:824] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e: Log is configured to *not* fsync() on all Append() calls
Aug 09 18:49:32 dist-test-slave-45dx krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301372, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.253@KRBTEST.COM
I20260809 18:49:32.799966 3084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e: No bootstrap required, opened a new log
I20260809 18:49:32.801970 3084 raft_consensus.cc:348] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } }
I20260809 18:49:32.802160 3084 raft_consensus.cc:374] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:32.802204 3084 raft_consensus.cc:729] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e05e69afed2b41b18871175e63d7d49e, State: Initialized, Role: FOLLOWER
I20260809 18:49:32.802430 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.794766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45168 (local address 127.12.202.253:35557)
0809 18:49:32.794815 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:32.794817 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:32.795066 (+ 249us) server_negotiation.cc:407] Connection header received
0809 18:49:32.795089 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:32.795090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:32.795101 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:32.795154 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:32.795796 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.796395 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.797106 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.797354 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.797428 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.799747 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:32.799748 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:32.799748 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:32.799754 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:32.801171 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.801552 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.801553 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.801553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.801603 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.801818 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.801818 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.801818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.801962 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:32.802099 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:32.802222 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 18:49:32.802296 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:49:32.802402 3084 consensus_queue.cc:260] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } }
I20260809 18:49:32.802753 3084 sys_catalog.cc:564] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:49:32.802716 3098 sys_catalog.cc:455] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } } }
I20260809 18:49:32.802862 3098 sys_catalog.cc:458] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:49:32.804786 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260809 18:49:32.804833 3115 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:49:32.804874 3115 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:49:32.805998 2840 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } attempt: 2
I20260809 18:49:32.806890 2972 master_runner.cc:186] Error getting master registration for 127.12.202.254:43711: OK, instance_id { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" instance_seqno: 1786301372463920 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 18:49:32.809895 2972 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 18:49:32.815796 3095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.806656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39516 (local address 127.12.202.252:45057)
0809 18:49:32.806767 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:32.806769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:32.806775 (+ 6us) server_negotiation.cc:407] Connection header received
0809 18:49:32.806794 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:32.806794 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:32.806804 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:32.806860 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:32.807560 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.808266 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.809349 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.809637 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.809675 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.811606 (+ 1931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:32.811607 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:32.811608 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:32.811614 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:32.814303 (+ 2689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.814873 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.814874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.814875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.814929 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.815147 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.815148 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.815148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.815304 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:32.815386 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:32.815629 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 18:49:32.815713 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
Aug 09 18:49:32 dist-test-slave-45dx krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301372, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for kudu/127.12.202.252@KRBTEST.COM
I20260809 18:49:32.817287 2843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.806271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39510 (local address 127.12.202.254:43711)
0809 18:49:32.806312 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:32.806314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:32.806533 (+ 219us) server_negotiation.cc:407] Connection header received
0809 18:49:32.806621 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:32.806622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:32.806632 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:32.806663 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:32.807422 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.808179 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.809201 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.809485 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.809525 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.811614 (+ 2089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:32.811615 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:32.811616 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:32.811622 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:32.814305 (+ 2683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.815593 (+ 1288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.815594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.815595 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.815647 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.816579 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.816581 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.816581 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.816710 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:32.816775 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:32.817119 (+ 344us) server_negotiation.cc:299] Negotiation successful
0809 18:49:32.817200 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:49:32.817788 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.806147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45178 (local address 127.12.202.253:35557)
0809 18:49:32.806184 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:32.806186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:32.806613 (+ 427us) server_negotiation.cc:407] Connection header received
0809 18:49:32.806712 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:32.806714 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:32.806726 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:32.806756 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:32.807560 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.808255 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.809358 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.809637 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.809674 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.812312 (+ 2638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:32.812313 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:32.812314 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:32.812341 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:32.813978 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.815316 (+ 1338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.815317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.815317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.815377 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.816259 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.816260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.816260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.816427 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:32.816517 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:32.817611 (+ 1094us) server_negotiation.cc:299] Negotiation successful
0809 18:49:32.817704 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 18:49:32.819597 2842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.806359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:45057 (local address 127.0.0.1:39500)
0809 18:49:32.806418 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.806430 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:32.806468 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:32.810265 (+ 3797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:32.810266 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:32.810445 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:32.810485 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:32.810487 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.812170 (+ 1683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.812171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:32.813050 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:32.813053 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.814591 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.814592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:32.814658 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.815057 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:32.815062 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:32.816549 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:32.818493 (+ 1944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:32.818494 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:32.818494 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:32.818699 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:32.818933 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:32.818934 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:32.818934 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:32.819000 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:32.819248 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:32.819249 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:32.819292 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 18:49:32.819395 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 18:49:32.819491 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 18:49:32.819653 3129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.809967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39500 (local address 127.12.202.252:45057)
0809 18:49:32.810136 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:32.810137 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:32.810145 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:49:32.810163 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:32.810164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:32.810174 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:32.810245 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:32.811344 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.812090 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.813119 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.814312 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.814827 (+ 515us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.816636 (+ 1809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:32.816637 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:32.816638 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:32.816645 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:32.818430 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.818785 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.818785 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.818786 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.818855 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.819070 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.819071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.819071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.819180 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:32.819255 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:32.819438 (+ 183us) server_negotiation.cc:299] Negotiation successful
0809 18:49:32.819513 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":109,"threads_started":1}
I20260809 18:49:32.821445 2840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a: Bootstrap starting.
I20260809 18:49:32.822248 2840 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:32.822566 2840 log.cc:824] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:32.823397 2840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a: No bootstrap required, opened a new log
I20260809 18:49:32.825398 2840 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } }
I20260809 18:49:32.825538 2840 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:32.825574 2840 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f299a4c922a4fa48451a4e44907741a, State: Initialized, Role: FOLLOWER
I20260809 18:49:32.825708 2840 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } }
I20260809 18:49:32.826030 2840 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:49:32.826004 3131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } } }
I20260809 18:49:32.826211 3131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a [sys.catalog]: This master's current role is: FOLLOWER
W20260809 18:49:32.828197 3150 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:49:32.828413 3150 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:49:32.828559 2727 master_runner.cc:186] Error getting master registration for 127.12.202.253:35557: OK, instance_id { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" instance_seqno: 1786301372615326 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 18:49:32.830549 2727 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 18:49:32.836269 3098 raft_consensus.cc:482] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:49:32.836401 3098 raft_consensus.cc:504] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } }
I20260809 18:49:32.836675 3098 leader_election.cc:288] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f299a4c922a4fa48451a4e44907741a (127.12.202.254:43711), 4e0e4f1aa17643eebf5d570850e65c1a (127.12.202.253:35557)
I20260809 18:49:32.836906 2797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e05e69afed2b41b18871175e63d7d49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f299a4c922a4fa48451a4e44907741a" is_pre_election: true
I20260809 18:49:32.837553 2797 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e05e69afed2b41b18871175e63d7d49e in term 0.
I20260809 18:49:32.837779 2997 leader_election.cc:302] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f299a4c922a4fa48451a4e44907741a, e05e69afed2b41b18871175e63d7d49e; no voters:
I20260809 18:49:32.837920 3098 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:49:32.837971 3098 raft_consensus.cc:482] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:49:32.837998 3098 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:32.838902 3098 raft_consensus.cc:504] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } }
I20260809 18:49:32.839025 3098 leader_election.cc:288] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [CANDIDATE]: Term 1 election: Requested vote from peers 5f299a4c922a4fa48451a4e44907741a (127.12.202.254:43711), 4e0e4f1aa17643eebf5d570850e65c1a (127.12.202.253:35557)
I20260809 18:49:32.839306 2797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e05e69afed2b41b18871175e63d7d49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f299a4c922a4fa48451a4e44907741a"
I20260809 18:49:32.839376 2797 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:32.840232 2797 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e05e69afed2b41b18871175e63d7d49e in term 1.
I20260809 18:49:32.840415 2997 leader_election.cc:302] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f299a4c922a4fa48451a4e44907741a, e05e69afed2b41b18871175e63d7d49e; no voters:
I20260809 18:49:32.840494 3098 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:49:32.840654 3098 raft_consensus.cc:686] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [term 1 LEADER]: Becoming Leader. State: Replica: e05e69afed2b41b18871175e63d7d49e, State: Running, Role: LEADER
I20260809 18:49:32.840749 3098 consensus_queue.cc:237] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } }
I20260809 18:49:32.841164 3152 sys_catalog.cc:455] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e05e69afed2b41b18871175e63d7d49e. Latest consensus state: current_term: 1 leader_uuid: "e05e69afed2b41b18871175e63d7d49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } } }
I20260809 18:49:32.841291 3152 sys_catalog.cc:458] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [sys.catalog]: This master's current role is: LEADER
I20260809 18:49:32.842208 3155 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:49:32.842545 3155 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:49:32.844138 2797 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a [term 1 FOLLOWER]: Refusing update from remote peer e05e69afed2b41b18871175e63d7d49e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:49:32.844445 3152 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:49:32.845789 3131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a [sys.catalog]: SysCatalogTable state changed. Reason: New leader e05e69afed2b41b18871175e63d7d49e. Latest consensus state: current_term: 1 leader_uuid: "e05e69afed2b41b18871175e63d7d49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } } }
I20260809 18:49:32.845867 3131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:49:32.846894 3098 sys_catalog.cc:455] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e05e69afed2b41b18871175e63d7d49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } } }
I20260809 18:49:32.846976 3098 sys_catalog.cc:458] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [sys.catalog]: This master's current role is: LEADER
I20260809 18:49:32.847116 3131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e05e69afed2b41b18871175e63d7d49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } } }
I20260809 18:49:32.847199 3131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:49:32.847520 3157 mvcc.cc:205] Tried to move back new op lower bound from 7316690423166947328 to 7316690423156428800. Current Snapshot: MvccSnapshot[applied={T|T < 7316690423166947328}]
I20260809 18:49:32.847746 3158 mvcc.cc:205] Tried to move back new op lower bound from 7316690423166947328 to 7316690423156428800. Current Snapshot: MvccSnapshot[applied={T|T < 7316690423166947328}]
I20260809 18:49:32.848043 3155 catalog_manager.cc:1347] Generated new cluster ID: a91f38754195414d939dcf234030676d
I20260809 18:49:32.848084 3155 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:49:32.852365 2961 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } attempt: 3
Aug 09 18:49:32 dist-test-slave-45dx krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301372, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.253@KRBTEST.COM for kudu/127.12.202.252@KRBTEST.COM
I20260809 18:49:32.861614 2964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.852601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:45057 (local address 127.0.0.1:39528)
0809 18:49:32.852644 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:32.852656 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:32.852696 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:32.852882 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:32.852883 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:32.853063 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:32.853104 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:32.853106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.854222 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.854223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:32.855031 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:32.855033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.855581 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.855582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:32.855645 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.856295 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:32.856314 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:32.858426 (+ 2112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:32.860464 (+ 2038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:32.860465 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:32.860465 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:32.860685 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:32.860919 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:32.860920 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:32.860920 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:32.860985 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:32.861305 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:32.861306 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:32.861361 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 18:49:32.861422 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 18:49:32.861511 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260809 18:49:32.862018 3129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:32.852641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39528 (local address 127.12.202.252:45057)
0809 18:49:32.852678 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:32.852680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:32.852688 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:49:32.852767 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:32.852769 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:32.852780 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:32.852828 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:32.853178 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.854125 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.855133 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:32.855454 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:32.855507 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:32.858520 (+ 3013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:32.858521 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:32.858522 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:32.858528 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:32.860309 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.860770 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.860771 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.860771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.860836 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:32.861061 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:32.861062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:32.861062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:32.861212 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:32.861266 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:32.861840 (+ 574us) server_negotiation.cc:299] Negotiation successful
0809 18:49:32.861930 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:49:32.863511 2961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a: Bootstrap starting.
I20260809 18:49:32.864226 2961 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:32.864547 2961 log.cc:824] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:32.865585 2961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a: No bootstrap required, opened a new log
I20260809 18:49:32.867660 2961 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } }
I20260809 18:49:32.867801 2961 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:32.867844 2961 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0e4f1aa17643eebf5d570850e65c1a, State: Initialized, Role: FOLLOWER
I20260809 18:49:32.867978 2961 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } }
I20260809 18:49:32.868348 2921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e05e69afed2b41b18871175e63d7d49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0e4f1aa17643eebf5d570850e65c1a"
I20260809 18:49:32.868345 2923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e05e69afed2b41b18871175e63d7d49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" is_pre_election: true
I20260809 18:49:32.868408 2920 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:32.870338 2920 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a [term 1 FOLLOWER]: Refusing update from remote peer e05e69afed2b41b18871175e63d7d49e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:49:32.870702 3152 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:49:32.868284 2961 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:49:32.873508 3167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e05e69afed2b41b18871175e63d7d49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } } }
I20260809 18:49:32.873597 3167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:49:32.873658 3167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader e05e69afed2b41b18871175e63d7d49e. Latest consensus state: current_term: 1 leader_uuid: "e05e69afed2b41b18871175e63d7d49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } } }
I20260809 18:49:32.873705 3167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:49:32.873739 3167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e05e69afed2b41b18871175e63d7d49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } } }
I20260809 18:49:32.873785 3167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:49:32.876799 3169 mvcc.cc:205] Tried to move back new op lower bound from 7316690423166947328 to 7316690423156428800. Current Snapshot: MvccSnapshot[applied={T|T < 7316690423166947328}]
I20260809 18:49:32.877638 3152 sys_catalog.cc:455] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e05e69afed2b41b18871175e63d7d49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f299a4c922a4fa48451a4e44907741a" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43711 } } peers { permanent_uuid: "4e0e4f1aa17643eebf5d570850e65c1a" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 35557 } } peers { permanent_uuid: "e05e69afed2b41b18871175e63d7d49e" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 45057 } } }
I20260809 18:49:32.877748 3152 sys_catalog.cc:458] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e [sys.catalog]: This master's current role is: LEADER
I20260809 18:49:32.878562 3155 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:49:32.879292 3155 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:49:32.883641 3204 catalog_manager.cc:1259] Loaded cluster ID: a91f38754195414d939dcf234030676d
I20260809 18:49:32.883695 3204 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a: loading cluster ID for follower catalog manager: success
I20260809 18:49:32.884581 3155 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e05e69afed2b41b18871175e63d7d49e: Generated new TSK 0
I20260809 18:49:32.884828 3204 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a: acquiring CA information for follower catalog manager: success
I20260809 18:49:32.884855 3155 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 18:49:32.884967 3204 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260809 18:49:33.828920 3150 catalog_manager.cc:1259] Loaded cluster ID: a91f38754195414d939dcf234030676d
I20260809 18:49:33.829021 3150 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a: loading cluster ID for follower catalog manager: success
I20260809 18:49:33.829885 3150 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a: acquiring CA information for follower catalog manager: success
I20260809 18:49:33.830228 3150 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5f299a4c922a4fa48451a4e44907741a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 18:49:33.885581 3204 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4e0e4f1aa17643eebf5d570850e65c1a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 18:49:33.943389 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 2727
I20260809 18:49:33.961472 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 2852
I20260809 18:49:33.972882 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 2972
2026-08-09T18:49:33Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3019 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:49:34 dist-test-slave-45dx krb5kdc[3216](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:49:34 dist-test-slave-45dx krb5kdc[3216](info): set up 2 sockets
Aug 09 18:49:34 dist-test-slave-45dx krb5kdc[3216](info): commencing operation
krb5kdc: starting...
W20260809 18:49:35.218768 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:49:35 dist-test-slave-45dx krb5kdc[3216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301375, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:49:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:49:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:49:35.346764 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:33847
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:36707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:33847
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:49:35.430024 3243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:35.430290 3243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:35.430341 3243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:35.431502 3243 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:49:35.431577 3243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:35.431600 3243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:35.431622 3243 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:49:35.431653 3243 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:49:35.433169 3243 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:36707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:33847
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:33847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:35.433446 3243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:35.433688 3243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:35.438688 3255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:35.438660 3259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:35.438660 3249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:35.438875 3243 server_base.cc:1034] running on GCE node
I20260809 18:49:35.439157 3243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:35.439450 3243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:35.440618 3243 hybrid_clock.cc:648] HybridClock initialized: now 1786301375440598 us; error 31 us; skew 500 ppm
Aug 09 18:49:35 dist-test-slave-45dx krb5kdc[3216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301375, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:35.443295 3243 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:49:35.443725 3243 webserver.cc:460] Webserver started at http://127.12.202.254:35555/ using document root <none> and password file <none>
I20260809 18:49:35.443953 3243 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:35.444022 3243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:35.444180 3243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:49:35.445348 3243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "9b22fe9433b847d9aadae857d4776081"
format_stamp: "Formatted at 2026-08-09 18:49:35 on dist-test-slave-45dx"
server_key: "41d175f5ea2707d1a79d5c4fc747e953"
server_key_iv: "aa58fa443e432ff7059fab428afa509e"
server_key_version: "encryptionkey@0"
I20260809 18:49:35.445729 3243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "9b22fe9433b847d9aadae857d4776081"
format_stamp: "Formatted at 2026-08-09 18:49:35 on dist-test-slave-45dx"
server_key: "41d175f5ea2707d1a79d5c4fc747e953"
server_key_iv: "aa58fa443e432ff7059fab428afa509e"
server_key_version: "encryptionkey@0"
I20260809 18:49:35.447091 3243 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:49:35.447861 3269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:35.448040 3243 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:49:35.448150 3243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "9b22fe9433b847d9aadae857d4776081"
format_stamp: "Formatted at 2026-08-09 18:49:35 on dist-test-slave-45dx"
server_key: "41d175f5ea2707d1a79d5c4fc747e953"
server_key_iv: "aa58fa443e432ff7059fab428afa509e"
server_key_version: "encryptionkey@0"
I20260809 18:49:35.448226 3243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:35.482183 3243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:35.484391 3243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:35.484575 3243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:35.488508 3243 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:33847
I20260809 18:49:35.488545 3361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:33847 every 8 connection(s)
I20260809 18:49:35.488922 3243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:49:35.489800 3363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:35.492134 3363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081: Bootstrap starting.
I20260809 18:49:35.492787 3363 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:35.493027 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 3243
I20260809 18:49:35.493091 3363 log.cc:824] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:35.493137 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:49:35.493322 13099 external_mini_cluster.cc:1428] Setting key 6bfb5fdfc00d2dfb8db77665ed6dc379
I20260809 18:49:35.493974 3363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081: No bootstrap required, opened a new log
I20260809 18:49:35.496764 3363 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b22fe9433b847d9aadae857d4776081" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 33847 } }
I20260809 18:49:35.496948 3363 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:35.496985 3363 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b22fe9433b847d9aadae857d4776081, State: Initialized, Role: FOLLOWER
I20260809 18:49:35.497107 3363 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b22fe9433b847d9aadae857d4776081" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 33847 } }
I20260809 18:49:35.497175 3363 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:49:35.497202 3363 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:49:35.497246 3363 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:35.497879 3363 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b22fe9433b847d9aadae857d4776081" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 33847 } }
I20260809 18:49:35.497999 3363 leader_election.cc:302] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b22fe9433b847d9aadae857d4776081; no voters:
I20260809 18:49:35.498183 3363 leader_election.cc:288] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:49:35.498210 3370 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:49:35.498379 3370 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081 [term 1 LEADER]: Becoming Leader. State: Replica: 9b22fe9433b847d9aadae857d4776081, State: Running, Role: LEADER
I20260809 18:49:35.498452 3363 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:49:35.498474 3370 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b22fe9433b847d9aadae857d4776081" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 33847 } }
I20260809 18:49:35.498760 3370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b22fe9433b847d9aadae857d4776081. Latest consensus state: current_term: 1 leader_uuid: "9b22fe9433b847d9aadae857d4776081" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b22fe9433b847d9aadae857d4776081" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 33847 } } }
I20260809 18:49:35.498855 3370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081 [sys.catalog]: This master's current role is: LEADER
I20260809 18:49:35.498771 3374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b22fe9433b847d9aadae857d4776081" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b22fe9433b847d9aadae857d4776081" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 33847 } } }
I20260809 18:49:35.498986 3374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081 [sys.catalog]: This master's current role is: LEADER
I20260809 18:49:35.499079 3380 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:49:35.499585 3380 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 18:49:35 dist-test-slave-45dx krb5kdc[3216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301375, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:35.502147 3380 catalog_manager.cc:1347] Generated new cluster ID: 3b28e420071241e8842a4f8fb7c2c137
I20260809 18:49:35.502205 3380 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:49:35.504976 3369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:35.493830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46082 (local address 127.12.202.254:33847)
0809 18:49:35.494020 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:35.494031 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:35.494067 (+ 36us) server_negotiation.cc:407] Connection header received
0809 18:49:35.494498 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:35.494505 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:35.494551 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:35.494663 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:35.495470 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:35.496479 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:35.497525 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:35.497916 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:35.498046 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:35.501110 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:35.501114 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:35.501115 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:35.501128 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:35.503241 (+ 2113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:35.503638 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:35.503640 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:35.503641 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:35.503753 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:35.503965 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:35.503966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:35.503967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:35.504275 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:35.504508 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:35.504589 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 18:49:35.504755 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":109,"threads_started":1}
I20260809 18:49:35.505949 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:49:35.513307 3380 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:49:35.513805 3380 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:49:35.520040 3380 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b22fe9433b847d9aadae857d4776081: Generated new TSK 0
I20260809 18:49:35.520227 3380 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:49:35.560402 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 3243
2026-08-09T18:49:35Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1590 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:49:35 dist-test-slave-45dx krb5kdc[3403](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:49:35 dist-test-slave-45dx krb5kdc[3403](info): set up 2 sockets
Aug 09 18:49:35 dist-test-slave-45dx krb5kdc[3403](info): commencing operation
krb5kdc: starting...
W20260809 18:49:36.818470 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.232s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:49:36 dist-test-slave-45dx krb5kdc[3403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301376, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:49:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:49:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:49:36.939863 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:36755
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:39379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:36755
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:49:37.021199 3422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:37.021448 3422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:37.021490 3422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:37.022630 3422 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:49:37.022707 3422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:37.022730 3422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:37.022750 3422 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:49:37.022780 3422 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:49:37.024216 3422 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:39379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:36755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:36755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:37.024526 3422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:37.024739 3422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:49:37.029651 3422 server_base.cc:1034] running on GCE node
W20260809 18:49:37.029605 3428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:37.029670 3429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:37.029606 3434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:37.030040 3422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:37.030359 3422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:37.031522 3422 hybrid_clock.cc:648] HybridClock initialized: now 1786301377031509 us; error 45 us; skew 500 ppm
Aug 09 18:49:37 dist-test-slave-45dx krb5kdc[3403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301377, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:37.034145 3422 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:49:37.034525 3422 webserver.cc:460] Webserver started at http://127.12.202.254:41595/ using document root <none> and password file <none>
I20260809 18:49:37.034703 3422 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:37.034744 3422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:37.034894 3422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:49:37.035890 3422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "84fa4b3bdbfe43cab589fa702a7242be"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "24cf8ae680e9591aa3009c702759e87a"
server_key_iv: "401bd64878d42433e32fe9b0fe506eaf"
server_key_version: "encryptionkey@0"
I20260809 18:49:37.036201 3422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "84fa4b3bdbfe43cab589fa702a7242be"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "24cf8ae680e9591aa3009c702759e87a"
server_key_iv: "401bd64878d42433e32fe9b0fe506eaf"
server_key_version: "encryptionkey@0"
I20260809 18:49:37.037616 3422 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:49:37.038375 3447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:37.038569 3422 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:49:37.038656 3422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "84fa4b3bdbfe43cab589fa702a7242be"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "24cf8ae680e9591aa3009c702759e87a"
server_key_iv: "401bd64878d42433e32fe9b0fe506eaf"
server_key_version: "encryptionkey@0"
I20260809 18:49:37.038713 3422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:37.057163 3422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:37.058864 3422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:37.058984 3422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:37.064532 3422 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:36755
I20260809 18:49:37.064626 3526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:36755 every 8 connection(s)
I20260809 18:49:37.064944 3422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:49:37.065409 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 3422
I20260809 18:49:37.065553 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:49:37.065835 13099 external_mini_cluster.cc:1428] Setting key 0ee5a0ccaac37330892ab65a0d73c250
I20260809 18:49:37.066319 3527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:37.069726 3527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be: Bootstrap starting.
I20260809 18:49:37.070449 3527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:37.070806 3527 log.cc:824] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:37.071667 3527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be: No bootstrap required, opened a new log
Aug 09 18:49:37 dist-test-slave-45dx krb5kdc[3403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301376, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:37.074342 3527 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fa4b3bdbfe43cab589fa702a7242be" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36755 } }
I20260809 18:49:37.074522 3527 raft_consensus.cc:374] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:37.074564 3527 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84fa4b3bdbfe43cab589fa702a7242be, State: Initialized, Role: FOLLOWER
I20260809 18:49:37.074712 3527 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fa4b3bdbfe43cab589fa702a7242be" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36755 } }
I20260809 18:49:37.074796 3527 raft_consensus.cc:388] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:49:37.074828 3527 raft_consensus.cc:482] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:49:37.074875 3527 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:37.075646 3527 raft_consensus.cc:504] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fa4b3bdbfe43cab589fa702a7242be" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36755 } }
I20260809 18:49:37.075759 3527 leader_election.cc:302] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84fa4b3bdbfe43cab589fa702a7242be; no voters:
I20260809 18:49:37.075948 3527 leader_election.cc:288] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:49:37.076015 3535 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:49:37.076157 3535 raft_consensus.cc:686] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 1 LEADER]: Becoming Leader. State: Replica: 84fa4b3bdbfe43cab589fa702a7242be, State: Running, Role: LEADER
I20260809 18:49:37.076231 3527 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:49:37.076257 3535 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fa4b3bdbfe43cab589fa702a7242be" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36755 } }
I20260809 18:49:37.076596 3535 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84fa4b3bdbfe43cab589fa702a7242be. Latest consensus state: current_term: 1 leader_uuid: "84fa4b3bdbfe43cab589fa702a7242be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fa4b3bdbfe43cab589fa702a7242be" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36755 } } }
I20260809 18:49:37.076685 3535 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [sys.catalog]: This master's current role is: LEADER
I20260809 18:49:37.076978 3538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84fa4b3bdbfe43cab589fa702a7242be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fa4b3bdbfe43cab589fa702a7242be" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36755 } } }
I20260809 18:49:37.077049 3532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.066373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50648 (local address 127.12.202.254:36755)
0809 18:49:37.066524 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:37.066532 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:37.066556 (+ 24us) server_negotiation.cc:407] Connection header received
0809 18:49:37.066989 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:37.066995 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:37.067036 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:37.067143 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:37.068003 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.068867 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.069939 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.070321 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.070406 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.073166 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:37.073171 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:37.073171 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:37.073184 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:37.075258 (+ 2074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:37.075600 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:37.075603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:37.075603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:37.075723 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:37.076037 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:37.076038 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:37.076038 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:37.076399 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:37.076535 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:37.076684 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 18:49:37.076831 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":70,"threads_started":1}
I20260809 18:49:37.077116 3538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [sys.catalog]: This master's current role is: LEADER
I20260809 18:49:37.077245 3544 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:49:37.078284 3544 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:49:37.079766 3544 catalog_manager.cc:1347] Generated new cluster ID: 6ffc4acf2df94a4dba43a2cb687b6d2d
I20260809 18:49:37.079818 3544 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:49:37.084197 3544 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:49:37.084790 3544 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:49:37.087105 3544 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be: Generated new TSK 0
I20260809 18:49:37.087287 3544 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
I20260809 18:49:37.122773 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36755
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:39379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:49:37.223407 3571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:37.223650 3571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:37.223690 3571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:37.224892 3571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:37.224953 3571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:37.224994 3571 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:49:37.226408 3571 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:39379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:37.226661 3571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:37.226888 3571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:37.232738 3577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:37.232825 3579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:37.232982 3571 server_base.cc:1034] running on GCE node
W20260809 18:49:37.233150 3581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:37.233387 3571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:37.233644 3571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:37.234848 3571 hybrid_clock.cc:648] HybridClock initialized: now 1786301377234830 us; error 33 us; skew 500 ppm
Aug 09 18:49:37 dist-test-slave-45dx krb5kdc[3403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301377, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:37.237715 3571 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:49:37.238152 3571 webserver.cc:460] Webserver started at http://127.12.202.193:42655/ using document root <none> and password file <none>
I20260809 18:49:37.238373 3571 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:37.238417 3571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:37.238585 3571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:49:37.239672 3571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "9ad613925df94b71838b2ca6332dea9e"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "3d09d84412e10eb1b1cab64f0c5ab72e"
server_key_iv: "382415d86eb91d734f940049a56b8d4b"
server_key_version: "encryptionkey@0"
I20260809 18:49:37.240038 3571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "9ad613925df94b71838b2ca6332dea9e"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "3d09d84412e10eb1b1cab64f0c5ab72e"
server_key_iv: "382415d86eb91d734f940049a56b8d4b"
server_key_version: "encryptionkey@0"
I20260809 18:49:37.241539 3571 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:49:37.242352 3594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:37.242594 3571 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:49:37.242694 3571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "9ad613925df94b71838b2ca6332dea9e"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "3d09d84412e10eb1b1cab64f0c5ab72e"
server_key_iv: "382415d86eb91d734f940049a56b8d4b"
server_key_version: "encryptionkey@0"
I20260809 18:49:37.242775 3571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:37.259111 3571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:37.261070 3571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:37.261245 3571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:37.261444 3571 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:49:37.261686 3571 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:49:37.261754 3571 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:37.261777 3571 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:49:37.261790 3571 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:37.267844 3571 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:35865
I20260809 18:49:37.267954 3793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:35865 every 8 connection(s)
I20260809 18:49:37.268328 3571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:49:37.269699 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 3571
I20260809 18:49:37.269797 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:49:37.269960 13099 external_mini_cluster.cc:1428] Setting key 1723f26e38cb249b9be09c6526709d04
Aug 09 18:49:37 dist-test-slave-45dx krb5kdc[3403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301377, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:37.279294 3532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.269160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:60007 (local address 127.12.202.254:36755)
0809 18:49:37.269232 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:37.269235 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:37.269454 (+ 219us) server_negotiation.cc:407] Connection header received
0809 18:49:37.270112 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:37.270113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:37.270127 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:37.270181 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:37.271301 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.271810 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.273256 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.273471 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.273529 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.276207 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:37.276208 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:37.276208 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:37.276217 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:37.277854 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:37.278287 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:37.278288 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:37.278288 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:37.278353 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:37.278624 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:37.278625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:37.278625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:37.278746 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:37.278827 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:37.279113 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 18:49:37.279198 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:49:37.279502 3797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.269142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:60007)
0809 18:49:37.269304 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:37.269360 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:37.270007 (+ 647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:37.270264 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:37.270268 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:37.271001 (+ 733us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:37.271196 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:37.271201 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.271922 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.271923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:37.273148 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:37.273152 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.273561 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.273562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:37.273712 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.274297 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:37.274308 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:37.276113 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:37.277946 (+ 1833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:37.277955 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:37.277957 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:37.278193 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:37.278431 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:37.278432 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:37.278433 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:37.278554 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:37.278817 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:37.278825 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:37.278976 (+ 151us) client_negotiation.cc:769] Sending connection context
0809 18:49:37.279089 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 18:49:37.279254 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":71,"threads_started":1}
WARNING: no policy specified for kudu/127.12.202.194@KRBTEST.COM; defaulting to no policy
I20260809 18:49:37.280006 3794 heartbeater.cc:347] Connected to a master server at 127.12.202.254:36755
I20260809 18:49:37.280134 3794 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:37.280372 3794 heartbeater.cc:511] Master 127.12.202.254:36755 requested a full tablet report, sending...
I20260809 18:49:37.280992 3474 ts_manager.cc:194] Registered new tserver with Master: 9ad613925df94b71838b2ca6332dea9e (127.12.202.193:35865)
I20260809 18:49:37.281567 3474 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:60007
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
I20260809 18:49:37.297536 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36755
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:39379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:49:37.378695 3803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:37.378895 3803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:37.378918 3803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:37.380005 3803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:37.380046 3803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:37.380071 3803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:49:37.381594 3803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:39379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:37.381860 3803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:37.382092 3803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:37.387053 3813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:37.387022 3809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:37.387032 3816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:37.387436 3803 server_base.cc:1034] running on GCE node
I20260809 18:49:37.387646 3803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:37.387882 3803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:37.389040 3803 hybrid_clock.cc:648] HybridClock initialized: now 1786301377389028 us; error 36 us; skew 500 ppm
Aug 09 18:49:37 dist-test-slave-45dx krb5kdc[3403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301377, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:37.391527 3803 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:49:37.391978 3803 webserver.cc:460] Webserver started at http://127.12.202.194:38205/ using document root <none> and password file <none>
I20260809 18:49:37.392205 3803 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:37.392270 3803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:37.392467 3803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:49:37.393507 3803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "c1c7551fc6f54728b81f347019c13ab1"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "8a840394d130d8aa73029672b91e8f89"
server_key_iv: "b8bb96c5b503a31863b3fda320559387"
server_key_version: "encryptionkey@0"
I20260809 18:49:37.393877 3803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "c1c7551fc6f54728b81f347019c13ab1"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "8a840394d130d8aa73029672b91e8f89"
server_key_iv: "b8bb96c5b503a31863b3fda320559387"
server_key_version: "encryptionkey@0"
I20260809 18:49:37.395206 3803 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:49:37.395907 3832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:37.396086 3803 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:49:37.396193 3803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "c1c7551fc6f54728b81f347019c13ab1"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "8a840394d130d8aa73029672b91e8f89"
server_key_iv: "b8bb96c5b503a31863b3fda320559387"
server_key_version: "encryptionkey@0"
I20260809 18:49:37.396266 3803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:37.407166 3803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:37.409500 3803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:37.409657 3803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:37.409874 3803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:49:37.410171 3803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:49:37.410223 3803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:37.410264 3803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:49:37.410290 3803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:37.416402 3803 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:34635
I20260809 18:49:37.416476 4024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:34635 every 8 connection(s)
I20260809 18:49:37.416778 3803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:49:37.422739 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 3803
Aug 09 18:49:37 dist-test-slave-45dx krb5kdc[3403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301377, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:37.422873 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:49:37.423061 13099 external_mini_cluster.cc:1428] Setting key a0ae29befb1af2805928bc589334a5a3
I20260809 18:49:37.426707 3532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.417538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:59171 (local address 127.12.202.254:36755)
0809 18:49:37.417596 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:37.417598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:37.417862 (+ 264us) server_negotiation.cc:407] Connection header received
0809 18:49:37.418363 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:37.418364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:37.418376 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:37.418456 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:37.419379 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.419903 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.420895 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.421083 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.421146 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.423422 (+ 2276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:37.423424 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:37.423424 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:37.423433 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:37.425050 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:37.425556 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:37.425557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:37.425557 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:37.425623 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:37.425900 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:37.425901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:37.425901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:37.426077 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:37.426154 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:37.426486 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 18:49:37.426586 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 18:49:37.426717 4029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.417505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:59171)
0809 18:49:37.417701 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:37.417745 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:37.418264 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:37.418545 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:37.418549 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:37.419110 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:37.419288 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:37.419292 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.419985 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.419985 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:37.420809 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:37.420811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.421162 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.421162 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:37.421256 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.421791 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:37.421799 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:37.423285 (+ 1486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:37.425133 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:37.425141 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:37.425143 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:37.425478 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:37.425687 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:37.425688 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:37.425688 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:37.425834 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:37.426154 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:37.426160 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:37.426331 (+ 171us) client_negotiation.cc:769] Sending connection context
0809 18:49:37.426435 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 18:49:37.426557 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":113,"threads_started":1}
I20260809 18:49:37.427717 4025 heartbeater.cc:347] Connected to a master server at 127.12.202.254:36755
I20260809 18:49:37.427819 4025 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:37.428022 4025 heartbeater.cc:511] Master 127.12.202.254:36755 requested a full tablet report, sending...
I20260809 18:49:37.428517 3474 ts_manager.cc:194] Registered new tserver with Master: c1c7551fc6f54728b81f347019c13ab1 (127.12.202.194:34635)
I20260809 18:49:37.428920 3474 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:59171
WARNING: no policy specified for kudu/127.12.202.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
I20260809 18:49:37.452910 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36755
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:39379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:49:37.536880 4034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:37.537164 4034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:37.537204 4034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:37.538367 4034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:37.538443 4034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:37.538486 4034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:49:37.539961 4034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:39379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:37.540232 4034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:37.540503 4034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:37.545876 4043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:37.545841 4045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:37.545846 4042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:37.545902 4034 server_base.cc:1034] running on GCE node
I20260809 18:49:37.546171 4034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:37.546445 4034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:37.547616 4034 hybrid_clock.cc:648] HybridClock initialized: now 1786301377547609 us; error 38 us; skew 500 ppm
Aug 09 18:49:37 dist-test-slave-45dx krb5kdc[3403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301377, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:37.554248 4034 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:49:37.554740 4034 webserver.cc:460] Webserver started at http://127.12.202.195:37941/ using document root <none> and password file <none>
I20260809 18:49:37.554944 4034 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:37.554984 4034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:37.555092 4034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:49:37.556126 4034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "1027e06aff924da7a054f5aae187c984"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "9eb611361addaa05315e039d31bb0389"
server_key_iv: "c30214c2c9ffb1b9f6568f03c620ba93"
server_key_version: "encryptionkey@0"
I20260809 18:49:37.556507 4034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "1027e06aff924da7a054f5aae187c984"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "9eb611361addaa05315e039d31bb0389"
server_key_iv: "c30214c2c9ffb1b9f6568f03c620ba93"
server_key_version: "encryptionkey@0"
I20260809 18:49:37.557839 4034 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:49:37.558544 4060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:37.558740 4034 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:49:37.558833 4034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "1027e06aff924da7a054f5aae187c984"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "9eb611361addaa05315e039d31bb0389"
server_key_iv: "c30214c2c9ffb1b9f6568f03c620ba93"
server_key_version: "encryptionkey@0"
I20260809 18:49:37.558903 4034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:37.584085 4034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:37.586061 4034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:37.586176 4034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:37.586373 4034 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:49:37.586720 4034 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:49:37.586757 4034 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:37.586781 4034 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:49:37.586792 4034 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:37.593199 4034 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:45353
I20260809 18:49:37.593259 4249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:45353 every 8 connection(s)
I20260809 18:49:37.593564 4034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:49:37.598497 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 4034
I20260809 18:49:37.598606 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:49:37.598788 13099 external_mini_cluster.cc:1428] Setting key b49c3b1c30f7802f1b7429b71b9129a3
Aug 09 18:49:37 dist-test-slave-45dx krb5kdc[3403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301377, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:37.602551 3532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.594281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:46397 (local address 127.12.202.254:36755)
0809 18:49:37.594347 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:37.594349 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:37.594583 (+ 234us) server_negotiation.cc:407] Connection header received
0809 18:49:37.595045 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:37.595046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:37.595056 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:37.595119 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:37.596038 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.596607 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.597552 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.597728 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.597788 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.600107 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:37.600108 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:37.600108 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:37.600114 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:37.601360 (+ 1246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:37.601744 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:37.601745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:37.601745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:37.601822 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:37.602040 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:37.602040 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:37.602041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:37.602139 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:37.602190 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:37.602425 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 18:49:37.602487 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 18:49:37.602730 4253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.594247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:46397)
0809 18:49:37.594434 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:37.594475 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:37.594959 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:37.595197 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:37.595200 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:37.595772 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:37.595955 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:37.595960 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.596684 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.596685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:37.597475 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:37.597477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.597807 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.597807 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:37.597901 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.598369 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:37.598377 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:37.600016 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:37.601451 (+ 1435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:37.601456 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:37.601458 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:37.601671 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:37.601888 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:37.601888 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:37.601889 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:37.601987 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:37.602195 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:37.602199 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:37.602314 (+ 115us) client_negotiation.cc:769] Sending connection context
0809 18:49:37.602393 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 18:49:37.602506 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":116,"threads_started":1}
I20260809 18:49:37.603277 4250 heartbeater.cc:347] Connected to a master server at 127.12.202.254:36755
I20260809 18:49:37.603359 4250 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:37.603546 4250 heartbeater.cc:511] Master 127.12.202.254:36755 requested a full tablet report, sending...
I20260809 18:49:37.603927 3474 ts_manager.cc:194] Registered new tserver with Master: 1027e06aff924da7a054f5aae187c984 (127.12.202.195:45353)
I20260809 18:49:37.604290 3474 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:46397
I20260809 18:49:37.610450 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:49:37.617319 3532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.611766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50660 (local address 127.12.202.254:36755)
0809 18:49:37.611805 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:37.611807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:37.611933 (+ 126us) server_negotiation.cc:407] Connection header received
0809 18:49:37.611967 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:37.611968 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:37.611975 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:37.612023 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:37.612633 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.613082 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.613754 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.613939 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.613993 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.615129 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:37.615129 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:37.615130 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:37.615135 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:37.616269 (+ 1134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:37.616635 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:37.616635 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:37.616636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:37.616685 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:37.616919 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:37.616920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:37.616920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:37.617040 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:37.617109 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:37.617209 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 18:49:37.617263 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 18:49:37.618958 3474 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50660:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:49:37.620623 3474 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:49:37.626751 4269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.622907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:34635 (local address 127.0.0.1:50232)
0809 18:49:37.623042 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:37.623085 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:37.623152 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:37.623488 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:37.623491 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:37.623494 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:37.623562 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:37.623564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.624610 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.624611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:37.625507 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:37.625509 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.626487 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.626488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:37.626566 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.626579 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 18:49:37.626625 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 18:49:37.626675 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
I20260809 18:49:37.627184 4271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.623029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50232 (local address 127.12.202.194:34635)
0809 18:49:37.623325 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:37.623330 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:37.623341 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:49:37.623378 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:37.623380 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:37.623395 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:37.623479 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:37.623665 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.624513 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.625659 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.626381 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.626958 (+ 577us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.627029 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:37.627055 (+ 26us) server_negotiation.cc:299] Negotiation successful
0809 18:49:37.627101 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":95,"threads_started":1}
I20260809 18:49:37.627198 4273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.623120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:35865 (local address 127.0.0.1:52404)
0809 18:49:37.623245 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:37.623256 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:37.623302 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:37.623842 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:37.623843 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:37.623846 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:37.623907 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:37.623909 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.625282 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.625283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:37.626213 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:37.626215 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.627010 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.627011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:37.627077 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.627081 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:49:37.627111 (+ 30us) client_negotiation.cc:240] Negotiation successful
0809 18:49:37.627150 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":87,"threads_started":1}
I20260809 18:49:37.627528 4278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.623304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:45353 (local address 127.0.0.1:54820)
0809 18:49:37.623429 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:37.623438 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:37.623474 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:37.623957 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:37.623958 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:37.623960 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:37.623998 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:37.624000 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.625315 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.625316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:37.626414 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:37.626417 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.627331 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.627333 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:37.627393 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.627397 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:49:37.627426 (+ 29us) client_negotiation.cc:240] Negotiation successful
0809 18:49:37.627466 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":91,"threads_started":1}
I20260809 18:49:37.627604 4277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.623259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52404 (local address 127.12.202.193:35865)
0809 18:49:37.623657 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:37.623662 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:37.623673 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:49:37.623713 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:37.623715 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:37.623731 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:37.623982 (+ 251us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:37.624066 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.625168 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.626300 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.626911 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.627361 (+ 450us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.627436 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:37.627462 (+ 26us) server_negotiation.cc:299] Negotiation successful
0809 18:49:37.627509 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":86,"threads_started":1}
I20260809 18:49:37.627820 4279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.623510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54820 (local address 127.12.202.195:45353)
0809 18:49:37.623755 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:37.623759 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:37.623767 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:49:37.623812 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:37.623814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:37.623828 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:37.624071 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:37.624136 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.625173 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.626505 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.627202 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.627622 (+ 420us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.627678 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:37.627704 (+ 26us) server_negotiation.cc:299] Negotiation successful
0809 18:49:37.627743 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":88,"threads_started":1}
I20260809 18:49:37.627883 3910 tablet_service.cc:1467] Processing CreateTablet for tablet b09ec58b83f34db399a73cfd71a25761 (DEFAULT_TABLE table=test-table [id=795fe697ce2f4402899b291fec53bf09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:49:37.628268 3910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b09ec58b83f34db399a73cfd71a25761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:37.628620 4142 tablet_service.cc:1467] Processing CreateTablet for tablet b09ec58b83f34db399a73cfd71a25761 (DEFAULT_TABLE table=test-table [id=795fe697ce2f4402899b291fec53bf09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:49:37.628737 3676 tablet_service.cc:1467] Processing CreateTablet for tablet b09ec58b83f34db399a73cfd71a25761 (DEFAULT_TABLE table=test-table [id=795fe697ce2f4402899b291fec53bf09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:49:37.628965 4142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b09ec58b83f34db399a73cfd71a25761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:37.629133 3676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b09ec58b83f34db399a73cfd71a25761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:37.631742 4280 tablet_bootstrap.cc:492] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e: Bootstrap starting.
I20260809 18:49:37.632159 4281 tablet_bootstrap.cc:492] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1: Bootstrap starting.
I20260809 18:49:37.632375 4282 tablet_bootstrap.cc:492] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984: Bootstrap starting.
I20260809 18:49:37.632664 4280 tablet_bootstrap.cc:654] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:37.632885 4281 tablet_bootstrap.cc:654] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:37.633034 4282 tablet_bootstrap.cc:654] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:37.633386 4280 log.cc:824] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:37.633523 4281 log.cc:824] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:37.633615 4282 log.cc:824] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:37.634302 4280 tablet_bootstrap.cc:492] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e: No bootstrap required, opened a new log
I20260809 18:49:37.634320 4282 tablet_bootstrap.cc:492] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984: No bootstrap required, opened a new log
I20260809 18:49:37.634334 4281 tablet_bootstrap.cc:492] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1: No bootstrap required, opened a new log
I20260809 18:49:37.634383 4280 ts_tablet_manager.cc:1397] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:49:37.634382 4281 ts_tablet_manager.cc:1397] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 18:49:37.634402 4282 ts_tablet_manager.cc:1397] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 18:49:37.636054 4282 raft_consensus.cc:348] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } }
I20260809 18:49:37.636226 4282 raft_consensus.cc:374] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:37.636271 4282 raft_consensus.cc:729] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1027e06aff924da7a054f5aae187c984, State: Initialized, Role: FOLLOWER
I20260809 18:49:37.636430 4282 consensus_queue.cc:260] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } }
I20260809 18:49:37.636519 4280 raft_consensus.cc:348] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } }
I20260809 18:49:37.636502 4281 raft_consensus.cc:348] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } }
I20260809 18:49:37.636672 4281 raft_consensus.cc:374] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:37.636672 4280 raft_consensus.cc:374] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:37.636708 4280 raft_consensus.cc:729] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad613925df94b71838b2ca6332dea9e, State: Initialized, Role: FOLLOWER
I20260809 18:49:37.636708 4281 raft_consensus.cc:729] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c7551fc6f54728b81f347019c13ab1, State: Initialized, Role: FOLLOWER
I20260809 18:49:37.636740 4282 ts_tablet_manager.cc:1428] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:49:37.636844 4280 consensus_queue.cc:260] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } }
I20260809 18:49:37.636844 4281 consensus_queue.cc:260] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } }
I20260809 18:49:37.636937 4250 heartbeater.cc:503] Master 127.12.202.254:36755 was elected leader, sending a full tablet report...
I20260809 18:49:37.637127 4280 ts_tablet_manager.cc:1428] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:49:37.637141 4025 heartbeater.cc:503] Master 127.12.202.254:36755 was elected leader, sending a full tablet report...
I20260809 18:49:37.637279 3794 heartbeater.cc:503] Master 127.12.202.254:36755 was elected leader, sending a full tablet report...
I20260809 18:49:37.637127 4281 ts_tablet_manager.cc:1428] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
W20260809 18:49:37.667490 4027 tablet.cc:2369] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:49:37.704000 4290 raft_consensus.cc:482] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:49:37.704191 4290 raft_consensus.cc:504] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } }
I20260809 18:49:37.704628 4290 leader_election.cc:288] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ad613925df94b71838b2ca6332dea9e (127.12.202.193:35865), 1027e06aff924da7a054f5aae187c984 (127.12.202.195:45353)
I20260809 18:49:37.708451 4279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.705101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:60883 (local address 127.12.202.195:45353)
0809 18:49:37.705160 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:37.705161 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:37.705240 (+ 79us) server_negotiation.cc:407] Connection header received
0809 18:49:37.705303 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:37.705304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:37.705315 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:37.705386 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:37.705519 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.706203 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.707474 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.708075 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.708154 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.708162 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:37.708336 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 18:49:37.708381 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 18:49:37.708449 4277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.704917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:35461 (local address 127.12.202.193:35865)
0809 18:49:37.704993 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:37.704996 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:37.705010 (+ 14us) server_negotiation.cc:407] Connection header received
0809 18:49:37.705046 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:37.705047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:37.705063 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:37.705145 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:37.705335 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.706099 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.707475 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.708075 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.708154 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.708162 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:37.708336 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 18:49:37.708375 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 18:49:37.708477 4029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.704837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:35865 (local address 127.12.202.194:35461)
0809 18:49:37.704905 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:37.704918 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:37.704964 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:37.705173 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:37.705175 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:37.705177 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:37.705255 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:37.705257 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.706180 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.706181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:37.707376 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:37.707379 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.708166 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.708168 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:37.708252 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.708254 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:49:37.708330 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 18:49:37.708381 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":13}
I20260809 18:49:37.708483 4292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.704984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:45353 (local address 127.12.202.194:60883)
0809 18:49:37.705169 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:37.705178 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:37.705232 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:37.705398 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:37.705398 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:37.705400 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:37.705448 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:37.705449 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.706273 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.706274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:37.707383 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:37.707385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.708167 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.708168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:37.708249 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.708253 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:49:37.708330 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 18:49:37.708384 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":4,"thread_start_us":119,"threads_started":1}
I20260809 18:49:37.708901 3711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b09ec58b83f34db399a73cfd71a25761" candidate_uuid: "c1c7551fc6f54728b81f347019c13ab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad613925df94b71838b2ca6332dea9e" is_pre_election: true
I20260809 18:49:37.708925 4174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b09ec58b83f34db399a73cfd71a25761" candidate_uuid: "c1c7551fc6f54728b81f347019c13ab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1027e06aff924da7a054f5aae187c984" is_pre_election: true
I20260809 18:49:37.709075 3711 raft_consensus.cc:2454] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1c7551fc6f54728b81f347019c13ab1 in term 0.
I20260809 18:49:37.709079 4174 raft_consensus.cc:2454] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1c7551fc6f54728b81f347019c13ab1 in term 0.
I20260809 18:49:37.709342 3837 leader_election.cc:302] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ad613925df94b71838b2ca6332dea9e, c1c7551fc6f54728b81f347019c13ab1; no voters:
I20260809 18:49:37.709511 4290 raft_consensus.cc:2781] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:49:37.709596 4290 raft_consensus.cc:482] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:49:37.709613 4290 raft_consensus.cc:3037] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:37.710400 4290 raft_consensus.cc:504] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } }
I20260809 18:49:37.710536 4290 leader_election.cc:288] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [CANDIDATE]: Term 1 election: Requested vote from peers 9ad613925df94b71838b2ca6332dea9e (127.12.202.193:35865), 1027e06aff924da7a054f5aae187c984 (127.12.202.195:45353)
I20260809 18:49:37.710757 3711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b09ec58b83f34db399a73cfd71a25761" candidate_uuid: "c1c7551fc6f54728b81f347019c13ab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad613925df94b71838b2ca6332dea9e"
I20260809 18:49:37.710759 4174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b09ec58b83f34db399a73cfd71a25761" candidate_uuid: "c1c7551fc6f54728b81f347019c13ab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1027e06aff924da7a054f5aae187c984"
I20260809 18:49:37.710841 4174 raft_consensus.cc:3037] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:37.710841 3711 raft_consensus.cc:3037] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:37.711755 4174 raft_consensus.cc:2454] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c7551fc6f54728b81f347019c13ab1 in term 1.
I20260809 18:49:37.711755 3711 raft_consensus.cc:2454] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c7551fc6f54728b81f347019c13ab1 in term 1.
I20260809 18:49:37.711936 3837 leader_election.cc:302] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ad613925df94b71838b2ca6332dea9e, c1c7551fc6f54728b81f347019c13ab1; no voters:
I20260809 18:49:37.712037 4290 raft_consensus.cc:2781] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:49:37.712193 4290 raft_consensus.cc:686] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [term 1 LEADER]: Becoming Leader. State: Replica: c1c7551fc6f54728b81f347019c13ab1, State: Running, Role: LEADER
I20260809 18:49:37.712292 4290 consensus_queue.cc:237] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } }
I20260809 18:49:37.713204 3464 catalog_manager.cc:5495] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1c7551fc6f54728b81f347019c13ab1 (127.12.202.194). New cstate: current_term: 1 leader_uuid: "c1c7551fc6f54728b81f347019c13ab1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } health_report { overall_health: UNKNOWN } } }
I20260809 18:49:37.721868 4271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.719422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50236 (local address 127.12.202.194:34635)
0809 18:49:37.719470 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:37.719473 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:37.719482 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:49:37.719537 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:37.719538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:37.719558 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:37.719642 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:49:37.719757 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.720244 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.721034 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:37.721239 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:37.721316 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:37.721496 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:49:37.721599 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:49:37.721694 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:37.721714 (+ 20us) server_negotiation.cc:299] Negotiation successful
0809 18:49:37.721753 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 18:49:37.723603 4174 raft_consensus.cc:1261] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984 [term 1 FOLLOWER]: Refusing update from remote peer c1c7551fc6f54728b81f347019c13ab1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:49:37.723611 3711 raft_consensus.cc:1261] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Refusing update from remote peer c1c7551fc6f54728b81f347019c13ab1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:49:37.723984 4297 consensus_queue.cc:1035] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:49:37.724112 4290 consensus_queue.cc:1035] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:49:37.726529 4301 mvcc.cc:205] Tried to move back new op lower bound from 7316690443153317888 to 7316690443110248448. Current Snapshot: MvccSnapshot[applied={T|T < 7316690443153317888}]
I20260809 18:49:37.726616 4302 mvcc.cc:205] Tried to move back new op lower bound from 7316690443153317888 to 7316690443110248448. Current Snapshot: MvccSnapshot[applied={T|T < 7316690443153317888}]
I20260809 18:49:37.726652 4304 mvcc.cc:205] Tried to move back new op lower bound from 7316690443153317888 to 7316690443110248448. Current Snapshot: MvccSnapshot[applied={T|T < 7316690443153317888}]
I20260809 18:49:37.728788 3464 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:49:37.728883 3464 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:49:37.729643 3464 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be: Sending DeleteTablet for 3 replicas of tablet b09ec58b83f34db399a73cfd71a25761
I20260809 18:49:37.729990 3910 tablet_service.cc:1514] Processing DeleteTablet for tablet b09ec58b83f34db399a73cfd71a25761 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:49:37 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:50232
I20260809 18:49:37.730072 3676 tablet_service.cc:1514] Processing DeleteTablet for tablet b09ec58b83f34db399a73cfd71a25761 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:49:37 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:52404
I20260809 18:49:37.730108 4142 tablet_service.cc:1514] Processing DeleteTablet for tablet b09ec58b83f34db399a73cfd71a25761 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:49:37 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:54820
I20260809 18:49:37.730329 4319 tablet_replica.cc:330] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e: stopping tablet replica
I20260809 18:49:37.730329 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 3571
I20260809 18:49:37.730440 4319 raft_consensus.cc:2229] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:49:37.730545 4319 raft_consensus.cc:2258] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:49:37.739722 4320 tablet_replica.cc:330] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984: stopping tablet replica
I20260809 18:49:37.739892 4320 raft_consensus.cc:2229] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:49:37.740021 4320 raft_consensus.cc:2258] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:49:37.740233 4318 tablet_replica.cc:330] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1: stopping tablet replica
I20260809 18:49:37.740396 4318 raft_consensus.cc:2229] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:49:37.740535 4318 raft_consensus.cc:2258] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:49:37.742558 4318 ts_tablet_manager.cc:1905] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:49:37.742828 4320 ts_tablet_manager.cc:1905] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:49:37.744632 4320 ts_tablet_manager.cc:1918] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:49:37.744719 4320 log.cc:1196] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/b09ec58b83f34db399a73cfd71a25761
I20260809 18:49:37.744828 4318 ts_tablet_manager.cc:1918] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:49:37.744923 4318 log.cc:1196] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/b09ec58b83f34db399a73cfd71a25761
I20260809 18:49:37.745011 4320 ts_tablet_manager.cc:1939] T b09ec58b83f34db399a73cfd71a25761 P 1027e06aff924da7a054f5aae187c984: Deleting consensus metadata
I20260809 18:49:37.745239 4318 ts_tablet_manager.cc:1939] T b09ec58b83f34db399a73cfd71a25761 P c1c7551fc6f54728b81f347019c13ab1: Deleting consensus metadata
I20260809 18:49:37.745534 3451 catalog_manager.cc:4841] TS 1027e06aff924da7a054f5aae187c984 (127.12.202.195:45353): tablet b09ec58b83f34db399a73cfd71a25761 (table test-table [id=795fe697ce2f4402899b291fec53bf09]) successfully deleted
I20260809 18:49:37.745639 3451 catalog_manager.cc:4841] TS c1c7551fc6f54728b81f347019c13ab1 (127.12.202.194:34635): tablet b09ec58b83f34db399a73cfd71a25761 (table test-table [id=795fe697ce2f4402899b291fec53bf09]) successfully deleted
W20260809 18:49:37.748131 3451 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.202.193:35865 (error 108)
I20260809 18:49:37.748600 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 3803
I20260809 18:49:37.748697 4278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:37.748543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:35865 (local address 127.0.0.1:52410)
0809 18:49:37.748610 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:37.748656 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:35865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 18:49:37.756063 3451 catalog_manager.cc:4584] TS 9ad613925df94b71838b2ca6332dea9e (127.12.202.193:35865): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b09ec58b83f34db399a73cfd71a25761: Network error: Client connection negotiation failed: client connection to 127.12.202.193:35865: connect: Connection refused (error 111)
I20260809 18:49:37.760154 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 4034
I20260809 18:49:37.770284 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 3422
I20260809 18:49:37.781929 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:36755
--webserver_interface=127.12.202.254
--webserver_port=41595
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:39379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:36755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:49:37.865545 4322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:37.865823 4322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:37.865865 4322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:37.867120 4322 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:49:37.867189 4322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:37.867210 4322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:37.867228 4322 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:49:37.867252 4322 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:49:37.868726 4322 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:39379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:36755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:36755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=41595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:37.869016 4322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:37.869247 4322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:37.879127 4332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:37.879113 4329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:37.879369 4322 server_base.cc:1034] running on GCE node
W20260809 18:49:37.879114 4328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:37.879771 4322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:37.880113 4322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:37.881260 4322 hybrid_clock.cc:648] HybridClock initialized: now 1786301377881238 us; error 38 us; skew 500 ppm
Aug 09 18:49:37 dist-test-slave-45dx krb5kdc[3403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301377, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:37.883809 4322 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:49:37.884264 4322 webserver.cc:460] Webserver started at http://127.12.202.254:41595/ using document root <none> and password file <none>
I20260809 18:49:37.884553 4322 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:37.884640 4322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:37.886046 4322 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:49:37.886740 4342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:37.886961 4322 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:49:37.887042 4322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "84fa4b3bdbfe43cab589fa702a7242be"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "24cf8ae680e9591aa3009c702759e87a"
server_key_iv: "401bd64878d42433e32fe9b0fe506eaf"
server_key_version: "encryptionkey@0"
I20260809 18:49:37.887442 4322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:37.908459 4322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:37.910434 4322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:37.910547 4322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:37.914825 4322 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:36755
I20260809 18:49:37.914878 4438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:36755 every 8 connection(s)
I20260809 18:49:37.915290 4322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:49:37.917074 4441 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:49:37.917275 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 4322
I20260809 18:49:37.917579 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:35865
--local_ip_for_outbound_sockets=127.12.202.193
--tserver_master_addrs=127.12.202.254:36755
--webserver_port=42655
--webserver_interface=127.12.202.193
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:39379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:49:37.917949 4441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be: Bootstrap starting.
I20260809 18:49:37.927903 4441 log.cc:824] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:37.929888 4441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:49:37.930202 4441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be: Bootstrap complete.
I20260809 18:49:37.932673 4441 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fa4b3bdbfe43cab589fa702a7242be" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36755 } }
I20260809 18:49:37.932924 4441 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84fa4b3bdbfe43cab589fa702a7242be, State: Initialized, Role: FOLLOWER
I20260809 18:49:37.933126 4441 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fa4b3bdbfe43cab589fa702a7242be" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36755 } }
I20260809 18:49:37.933225 4441 raft_consensus.cc:388] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:49:37.933284 4441 raft_consensus.cc:482] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:49:37.933341 4441 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 1 FOLLOWER]: Advancing to term 2
I20260809 18:49:37.934340 4441 raft_consensus.cc:504] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fa4b3bdbfe43cab589fa702a7242be" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36755 } }
I20260809 18:49:37.934459 4441 leader_election.cc:302] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84fa4b3bdbfe43cab589fa702a7242be; no voters:
I20260809 18:49:37.934657 4441 leader_election.cc:288] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 18:49:37.934693 4448 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 2 FOLLOWER]: Leader election won for term 2
I20260809 18:49:37.934813 4448 raft_consensus.cc:686] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 2 LEADER]: Becoming Leader. State: Replica: 84fa4b3bdbfe43cab589fa702a7242be, State: Running, Role: LEADER
I20260809 18:49:37.934950 4441 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:49:37.934984 4448 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fa4b3bdbfe43cab589fa702a7242be" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36755 } }
I20260809 18:49:37.935493 4449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "84fa4b3bdbfe43cab589fa702a7242be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fa4b3bdbfe43cab589fa702a7242be" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36755 } } }
I20260809 18:49:37.935505 4450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84fa4b3bdbfe43cab589fa702a7242be. Latest consensus state: current_term: 2 leader_uuid: "84fa4b3bdbfe43cab589fa702a7242be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fa4b3bdbfe43cab589fa702a7242be" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36755 } } }
I20260809 18:49:37.935632 4450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [sys.catalog]: This master's current role is: LEADER
I20260809 18:49:37.935588 4449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [sys.catalog]: This master's current role is: LEADER
I20260809 18:49:37.936126 4456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:49:37.936935 4456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:49:37.937088 4456 catalog_manager.cc:1259] Loaded cluster ID: 6ffc4acf2df94a4dba43a2cb687b6d2d
I20260809 18:49:37.937307 4456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:49:37.937549 4456 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 18:49:37.942207 4456 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 18:49:37.944628 4456 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:49:37.944830 4456 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be: Loaded TSK: 0
I20260809 18:49:37.945032 4456 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 18:49:38.004184 4443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:38.004463 4443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:38.004491 4443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:38.005658 4443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:38.005699 4443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:38.005726 4443 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:49:38.007217 4443 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:39379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:35865
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=42655
--tserver_master_addrs=127.12.202.254:36755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4443
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:38.007432 4443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:38.007674 4443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:38.012908 4480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:38.012946 4479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:38.013127 4443 server_base.cc:1034] running on GCE node
W20260809 18:49:38.012948 4486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:38.013463 4443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:38.013746 4443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:38.014945 4443 hybrid_clock.cc:648] HybridClock initialized: now 1786301378014937 us; error 34 us; skew 500 ppm
Aug 09 18:49:38 dist-test-slave-45dx krb5kdc[3403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301378, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:38.017983 4443 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:49:38.018537 4443 webserver.cc:460] Webserver started at http://127.12.202.193:42655/ using document root <none> and password file <none>
I20260809 18:49:38.018816 4443 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:38.018904 4443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:38.020624 4443 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:49:38.021417 4495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:38.021607 4443 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:49:38.021704 4443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "9ad613925df94b71838b2ca6332dea9e"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "3d09d84412e10eb1b1cab64f0c5ab72e"
server_key_iv: "382415d86eb91d734f940049a56b8d4b"
server_key_version: "encryptionkey@0"
I20260809 18:49:38.022073 4443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:38.029845 4443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:38.031968 4443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:38.032104 4443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:38.032367 4443 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:49:38.032840 4508 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 18:49:38.034744 4443 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 18:49:38.034806 4443 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 18:49:38.034848 4443 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 18:49:38.035554 4443 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 18:49:38.035609 4443 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 18:49:38.035670 4508 tablet_bootstrap.cc:492] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e: Bootstrap starting.
I20260809 18:49:38.043079 4443 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:35865
I20260809 18:49:38.043125 4680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:35865 every 8 connection(s)
I20260809 18:49:38.043504 4443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:49:38.043809 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 4443
I20260809 18:49:38.044123 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:34635
--local_ip_for_outbound_sockets=127.12.202.194
--tserver_master_addrs=127.12.202.254:36755
--webserver_port=38205
--webserver_interface=127.12.202.194
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:39379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:49:38.047449 4508 log.cc:824] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:38.050521 4508 tablet_bootstrap.cc:492] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:49:38.050858 4508 tablet_bootstrap.cc:492] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e: Bootstrap complete.
I20260809 18:49:38.052214 4508 ts_tablet_manager.cc:1397] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.005s
I20260809 18:49:38.054361 4508 raft_consensus.cc:348] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } }
I20260809 18:49:38.054700 4508 raft_consensus.cc:729] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad613925df94b71838b2ca6332dea9e, State: Initialized, Role: FOLLOWER
I20260809 18:49:38.054872 4508 consensus_queue.cc:260] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } }
I20260809 18:49:38.055187 4508 ts_tablet_manager.cc:1428] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e: Time spent starting tablet: real 0.003s user 0.000s sys 0.006s
Aug 09 18:49:38 dist-test-slave-45dx krb5kdc[3403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301378, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:38.066442 4689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.048560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:43991)
0809 18:49:38.052726 (+ 4166us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:38.052775 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:38.053895 (+ 1120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:38.054570 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:38.054574 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:38.055286 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:38.055597 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:38.055604 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.057327 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.057328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:38.058672 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:38.058675 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.059445 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.059446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:38.059575 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.060239 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:38.060250 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:38.062164 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:38.064617 (+ 2453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:38.064625 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:38.064628 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:38.064939 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:38.065231 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:38.065231 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:38.065232 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:38.065364 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:38.065796 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:38.065801 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:38.065948 (+ 147us) client_negotiation.cc:769] Sending connection context
0809 18:49:38.066067 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 18:49:38.066222 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4120,"thread_start_us":91,"threads_started":1}
I20260809 18:49:38.066471 4688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.048555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:43991 (local address 127.12.202.254:36755)
0809 18:49:38.052625 (+ 4070us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:38.052635 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:38.052895 (+ 260us) server_negotiation.cc:407] Connection header received
0809 18:49:38.054149 (+ 1254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:38.054157 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:38.054221 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:38.054336 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:38.055747 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.057207 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.058778 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.059347 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.059456 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.062280 (+ 2824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:38.062284 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:38.062284 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:38.062296 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:38.064531 (+ 2235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:38.065035 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:38.065038 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:38.065038 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:38.065155 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:38.065445 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:38.065446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:38.065446 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:38.065720 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:38.065815 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:38.066139 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 18:49:38.066269 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4008,"thread_start_us":85,"threads_started":1}
I20260809 18:49:38.068063 4682 heartbeater.cc:347] Connected to a master server at 127.12.202.254:36755
I20260809 18:49:38.068156 4682 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:38.068367 4682 heartbeater.cc:511] Master 127.12.202.254:36755 requested a full tablet report, sending...
I20260809 18:49:38.069123 4370 ts_manager.cc:194] Registered new tserver with Master: 9ad613925df94b71838b2ca6332dea9e (127.12.202.193:35865)
I20260809 18:49:38.070348 4370 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:43991
I20260809 18:49:38.071614 4682 heartbeater.cc:503] Master 127.12.202.254:36755 was elected leader, sending a full tablet report...
I20260809 18:49:38.075829 4692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.070743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:35865 (local address 127.0.0.1:52416)
0809 18:49:38.070934 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:38.070969 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:38.071032 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:38.072162 (+ 1130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:38.072165 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:38.072167 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:38.072222 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:38.072224 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.073490 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.073491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:38.074718 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:38.074721 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.075543 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.075544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:38.075616 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.075628 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 18:49:38.075698 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 18:49:38.075748 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":109,"threads_started":1}
I20260809 18:49:38.075842 4693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.071002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52416 (local address 127.12.202.193:35865)
0809 18:49:38.071966 (+ 964us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:38.071970 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:38.071981 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:49:38.072011 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:38.072013 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:38.072027 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:38.072152 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:38.072293 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.073402 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.074811 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.075475 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.075545 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.075587 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:38.075721 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 18:49:38.075760 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":787,"thread_start_us":74,"threads_started":1}
I20260809 18:49:38.076642 4575 tablet_service.cc:1514] Processing DeleteTablet for tablet b09ec58b83f34db399a73cfd71a25761 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:49:37 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:52416
I20260809 18:49:38.077307 4695 tablet_replica.cc:330] stopping tablet replica
I20260809 18:49:38.077425 4695 raft_consensus.cc:2229] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:49:38.077502 4695 raft_consensus.cc:2258] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:49:38.077801 4695 ts_tablet_manager.cc:1905] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:49:38.080117 4695 ts_tablet_manager.cc:1918] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:49:38.080196 4695 log.cc:1196] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/wal/wals/b09ec58b83f34db399a73cfd71a25761
I20260809 18:49:38.080469 4695 ts_tablet_manager.cc:1939] T b09ec58b83f34db399a73cfd71a25761 P 9ad613925df94b71838b2ca6332dea9e: Deleting consensus metadata
I20260809 18:49:38.080964 4350 catalog_manager.cc:4841] TS 9ad613925df94b71838b2ca6332dea9e (127.12.202.193:35865): tablet b09ec58b83f34db399a73cfd71a25761 (table test-table [id=795fe697ce2f4402899b291fec53bf09]) successfully deleted
W20260809 18:49:38.135318 4686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:38.135593 4686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:38.135622 4686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:38.136895 4686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:38.136937 4686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:38.136963 4686 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:49:38.138419 4686 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:39379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:34635
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=38205
--tserver_master_addrs=127.12.202.254:36755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4686
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:38.138655 4686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:38.138888 4686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:38.144424 4711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:38.144431 4706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:38.144431 4705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:38.144755 4686 server_base.cc:1034] running on GCE node
I20260809 18:49:38.144986 4686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:38.145263 4686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:38.146428 4686 hybrid_clock.cc:648] HybridClock initialized: now 1786301378146417 us; error 33 us; skew 500 ppm
Aug 09 18:49:38 dist-test-slave-45dx krb5kdc[3403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301378, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:38.149166 4686 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:49:38.149636 4686 webserver.cc:460] Webserver started at http://127.12.202.194:38205/ using document root <none> and password file <none>
I20260809 18:49:38.149873 4686 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:38.149950 4686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:38.151352 4686 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:49:38.151957 4722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:38.152159 4686 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:38.152268 4686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "c1c7551fc6f54728b81f347019c13ab1"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "8a840394d130d8aa73029672b91e8f89"
server_key_iv: "b8bb96c5b503a31863b3fda320559387"
server_key_version: "encryptionkey@0"
I20260809 18:49:38.152673 4686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:38.170176 4686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:38.172570 4686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:38.172744 4686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:38.172974 4686 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:49:38.173280 4686 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:49:38.173333 4686 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:38.173374 4686 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:49:38.173404 4686 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:38.179423 4686 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:34635
I20260809 18:49:38.179459 4914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:34635 every 8 connection(s)
I20260809 18:49:38.179801 4686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:49:38.182632 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 4686
I20260809 18:49:38.182950 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:45353
--local_ip_for_outbound_sockets=127.12.202.195
--tserver_master_addrs=127.12.202.254:36755
--webserver_port=37941
--webserver_interface=127.12.202.195
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:39379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:49:38 dist-test-slave-45dx krb5kdc[3403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301378, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:38.190449 4919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.180554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:59387)
0809 18:49:38.180725 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:38.180761 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:38.181236 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:38.181460 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:38.181463 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:38.182062 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:38.182244 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:38.182248 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.183014 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.183015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:38.183903 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:38.183906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.184330 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.184332 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:38.184458 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.184977 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:38.184988 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:38.186557 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:38.188477 (+ 1920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:38.188484 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:38.188518 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:38.188841 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:38.189093 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:38.189093 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:38.189094 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:38.189261 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:38.189714 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:38.189723 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:38.189890 (+ 167us) client_negotiation.cc:769] Sending connection context
0809 18:49:38.190012 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 18:49:38.190193 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":88,"threads_started":1}
I20260809 18:49:38.191660 4688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.180572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:59387 (local address 127.12.202.254:36755)
0809 18:49:38.180744 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:38.180746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:38.180855 (+ 109us) server_negotiation.cc:407] Connection header received
0809 18:49:38.181321 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:38.181322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:38.181336 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:38.181407 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:38.182340 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.182911 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.184001 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.184208 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.184318 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.186677 (+ 2359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:38.186679 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:38.186679 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:38.186688 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:38.188395 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:38.188915 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:38.188916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:38.188917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:38.189007 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:38.189344 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:38.189345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:38.189346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:38.189587 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:38.189692 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:38.191394 (+ 1702us) server_negotiation.cc:299] Negotiation successful
0809 18:49:38.191509 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144}
I20260809 18:49:38.192142 4915 heartbeater.cc:347] Connected to a master server at 127.12.202.254:36755
I20260809 18:49:38.192233 4915 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:38.192449 4915 heartbeater.cc:511] Master 127.12.202.254:36755 requested a full tablet report, sending...
I20260809 18:49:38.192941 4370 ts_manager.cc:194] Registered new tserver with Master: c1c7551fc6f54728b81f347019c13ab1 (127.12.202.194:34635)
I20260809 18:49:38.193496 4370 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:59387
W20260809 18:49:38.270754 4921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:38.270946 4921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:38.270968 4921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:38.272075 4921 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:38.272110 4921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:38.272136 4921 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:49:38.273623 4921 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:39379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:45353
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=37941
--tserver_master_addrs=127.12.202.254:36755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4921
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:38.273813 4921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:38.273994 4921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:38.279145 4927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:38.279153 4926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:38.279165 4929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:38.279356 4921 server_base.cc:1034] running on GCE node
I20260809 18:49:38.279553 4921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:38.279821 4921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:38.280982 4921 hybrid_clock.cc:648] HybridClock initialized: now 1786301378280969 us; error 26 us; skew 500 ppm
Aug 09 18:49:38 dist-test-slave-45dx krb5kdc[3403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301378, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:38.283595 4921 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:49:38.283998 4921 webserver.cc:460] Webserver started at http://127.12.202.195:37941/ using document root <none> and password file <none>
I20260809 18:49:38.284205 4921 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:38.284258 4921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:38.285652 4921 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:49:38.286327 4941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:38.286526 4921 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:49:38.286597 4921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "1027e06aff924da7a054f5aae187c984"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "9eb611361addaa05315e039d31bb0389"
server_key_iv: "c30214c2c9ffb1b9f6568f03c620ba93"
server_key_version: "encryptionkey@0"
I20260809 18:49:38.287030 4921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:38.303016 4921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:38.305426 4921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:38.305589 4921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:38.305835 4921 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:49:38.306152 4921 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:49:38.306187 4921 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:38.306209 4921 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:49:38.306255 4921 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:38.312291 4921 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:45353
I20260809 18:49:38.312359 5131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:45353 every 8 connection(s)
I20260809 18:49:38.312724 4921 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:49:38 dist-test-slave-45dx krb5kdc[3403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301378, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:38.319514 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 4921
I20260809 18:49:38.322228 4688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.313458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:43587 (local address 127.12.202.254:36755)
0809 18:49:38.313528 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:38.313530 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:38.313766 (+ 236us) server_negotiation.cc:407] Connection header received
0809 18:49:38.314324 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:38.314325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:38.314338 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:38.314403 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:38.315374 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.315867 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.316870 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.317067 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.317158 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.319133 (+ 1975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:38.319134 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:38.319135 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:38.319142 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:38.320886 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:38.321267 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:38.321268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:38.321269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:38.321334 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:38.321561 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:38.321562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:38.321562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:38.321697 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:38.321767 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:38.322098 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 18:49:38.322163 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 18:49:38.322448 5136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.313460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:43587)
0809 18:49:38.313639 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:38.313675 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:38.314211 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:38.314489 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:38.314492 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:38.315051 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:38.315254 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:38.315259 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.315978 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.315979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:38.316762 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:38.316764 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.317173 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.317174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:38.317294 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.317709 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:38.317716 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:38.319023 (+ 1307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:38.320975 (+ 1952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:38.320981 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:38.320983 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:38.321192 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:38.321402 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:38.321402 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:38.321403 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:38.321499 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:38.321772 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:38.321778 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:38.321952 (+ 174us) client_negotiation.cc:769] Sending connection context
0809 18:49:38.322071 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 18:49:38.322228 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":88,"threads_started":1}
I20260809 18:49:38.322988 5133 heartbeater.cc:347] Connected to a master server at 127.12.202.254:36755
I20260809 18:49:38.323096 5133 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:38.323294 5133 heartbeater.cc:511] Master 127.12.202.254:36755 requested a full tablet report, sending...
I20260809 18:49:38.323748 4370 ts_manager.cc:194] Registered new tserver with Master: 1027e06aff924da7a054f5aae187c984 (127.12.202.195:45353)
I20260809 18:49:38.324106 4370 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:43587
I20260809 18:49:38.326674 5142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.320093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50670 (local address 127.12.202.254:36755)
0809 18:49:38.320211 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:38.320213 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:38.320219 (+ 6us) server_negotiation.cc:407] Connection header received
0809 18:49:38.320237 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:38.320237 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:38.320246 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:38.320345 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:38.321001 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.321590 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.322640 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.322929 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.322994 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.324315 (+ 1321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:38.324317 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:38.324317 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:38.324324 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:38.325773 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:38.326080 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:38.326081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:38.326081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:38.326133 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:38.326292 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:38.326293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:38.326293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:38.326384 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:38.326507 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:38.326533 (+ 26us) server_negotiation.cc:299] Negotiation successful
0809 18:49:38.326590 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":76,"threads_started":1}
I20260809 18:49:38.327390 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:49:38.329747 5142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.327711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50680 (local address 127.12.202.254:36755)
0809 18:49:38.327743 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:38.327745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:38.327843 (+ 98us) server_negotiation.cc:407] Connection header received
0809 18:49:38.327911 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:38.327912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:38.327937 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:38.327989 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:49:38.328083 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.328546 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.329180 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.329362 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.329409 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.329528 (+ 119us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:49:38.329607 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:49:38.329656 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:38.329689 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 18:49:38.329704 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 18:49:38.330027 4370 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:50680:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:49:38.331598 4370 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:49:38.334084 4575 tablet_service.cc:1467] Processing CreateTablet for tablet 9b5858a0c1bf4e1caf1962c660636f76 (DEFAULT_TABLE table=test-table [id=1f3dd696f2814baaafc140d490422b8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:49:38.334321 4575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b5858a0c1bf4e1caf1962c660636f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:38.336009 4508 tablet_bootstrap.cc:492] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e: Bootstrap starting.
I20260809 18:49:38.336457 4508 tablet_bootstrap.cc:654] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:38.337133 4508 tablet_bootstrap.cc:492] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e: No bootstrap required, opened a new log
I20260809 18:49:38.337196 4508 ts_tablet_manager.cc:1397] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:49:38.337368 4508 raft_consensus.cc:348] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } }
I20260809 18:49:38.337451 4508 raft_consensus.cc:374] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:38.337509 4508 raft_consensus.cc:729] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad613925df94b71838b2ca6332dea9e, State: Initialized, Role: FOLLOWER
I20260809 18:49:38.337556 4508 consensus_queue.cc:260] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } }
I20260809 18:49:38.337605 5144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.333588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:45353 (local address 127.0.0.1:54824)
0809 18:49:38.333721 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:38.333730 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:38.333771 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:38.334168 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:38.334168 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:38.334170 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:38.334231 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:38.334232 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.335442 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.335443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:38.336290 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:38.336293 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.337374 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.337375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:38.337435 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.337439 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:49:38.337492 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 18:49:38.337535 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":94,"threads_started":1}
I20260809 18:49:38.337661 4508 ts_tablet_manager.cc:1428] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 18:49:38.337853 5150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.333865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54824 (local address 127.12.202.195:45353)
0809 18:49:38.334013 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:38.334017 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:38.334026 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:49:38.334059 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:38.334060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:38.334074 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:38.334158 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:38.334304 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.335323 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.336434 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.337183 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.337258 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.337321 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:38.337738 (+ 417us) server_negotiation.cc:299] Negotiation successful
0809 18:49:38.337782 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":82,"threads_started":1}
I20260809 18:49:38.338546 5014 tablet_service.cc:1467] Processing CreateTablet for tablet 9b5858a0c1bf4e1caf1962c660636f76 (DEFAULT_TABLE table=test-table [id=1f3dd696f2814baaafc140d490422b8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:49:38.338888 5014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b5858a0c1bf4e1caf1962c660636f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:38.339349 4692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.333482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:34635 (local address 127.0.0.1:50244)
0809 18:49:38.333533 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:38.333543 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:38.333580 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:38.336014 (+ 2434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:38.336014 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:38.336016 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:38.336052 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:38.336053 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.337287 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.337288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:38.338285 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:38.338287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.339199 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.339200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:38.339243 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.339246 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:49:38.339280 (+ 34us) client_negotiation.cc:240] Negotiation successful
0809 18:49:38.339309 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 18:49:38.339422 5146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.333599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50244 (local address 127.12.202.194:34635)
0809 18:49:38.333777 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:38.333782 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:38.333792 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:49:38.333834 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:38.333836 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:38.333851 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:38.333942 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:38.336160 (+ 2218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.337150 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.338386 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.339115 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.339177 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.339223 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:38.339305 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 18:49:38.339346 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":108,"threads_started":1}
I20260809 18:49:38.339956 4798 tablet_service.cc:1467] Processing CreateTablet for tablet 9b5858a0c1bf4e1caf1962c660636f76 (DEFAULT_TABLE table=test-table [id=1f3dd696f2814baaafc140d490422b8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:49:38.340251 4798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b5858a0c1bf4e1caf1962c660636f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:38.341710 5152 tablet_bootstrap.cc:492] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984: Bootstrap starting.
I20260809 18:49:38.342370 5152 tablet_bootstrap.cc:654] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:38.342872 5152 log.cc:824] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:38.343154 5155 tablet_bootstrap.cc:492] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1: Bootstrap starting.
I20260809 18:49:38.343631 5152 tablet_bootstrap.cc:492] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984: No bootstrap required, opened a new log
I20260809 18:49:38.343688 5152 ts_tablet_manager.cc:1397] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:49:38.343753 5155 tablet_bootstrap.cc:654] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:38.344210 5155 log.cc:824] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:38.345185 5155 tablet_bootstrap.cc:492] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1: No bootstrap required, opened a new log
I20260809 18:49:38.345258 5155 ts_tablet_manager.cc:1397] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 18:49:38.345584 5152 raft_consensus.cc:348] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } }
I20260809 18:49:38.345758 5152 raft_consensus.cc:374] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:38.345793 5152 raft_consensus.cc:729] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1027e06aff924da7a054f5aae187c984, State: Initialized, Role: FOLLOWER
I20260809 18:49:38.345957 5152 consensus_queue.cc:260] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } }
I20260809 18:49:38.346238 5152 ts_tablet_manager.cc:1428] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:49:38.346272 5133 heartbeater.cc:503] Master 127.12.202.254:36755 was elected leader, sending a full tablet report...
I20260809 18:49:38.347177 5155 raft_consensus.cc:348] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } }
I20260809 18:49:38.347322 5155 raft_consensus.cc:374] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:38.347345 5155 raft_consensus.cc:729] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1c7551fc6f54728b81f347019c13ab1, State: Initialized, Role: FOLLOWER
I20260809 18:49:38.347424 5155 consensus_queue.cc:260] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } }
I20260809 18:49:38.347643 5155 ts_tablet_manager.cc:1428] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 18:49:38.347680 4915 heartbeater.cc:503] Master 127.12.202.254:36755 was elected leader, sending a full tablet report...
W20260809 18:49:38.430513 4916 tablet.cc:2369] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:49:38.549150 5162 raft_consensus.cc:482] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:49:38.549285 5162 raft_consensus.cc:504] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } }
I20260809 18:49:38.549734 5162 leader_election.cc:288] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1027e06aff924da7a054f5aae187c984 (127.12.202.195:45353), 9ad613925df94b71838b2ca6332dea9e (127.12.202.193:35865)
W20260809 18:49:38.552870 4684 tablet.cc:2369] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:49:38.553643 4693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.550182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:53105 (local address 127.12.202.193:35865)
0809 18:49:38.550244 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:38.550246 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:38.550327 (+ 81us) server_negotiation.cc:407] Connection header received
0809 18:49:38.550377 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:38.550378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:38.550386 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:38.550456 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:38.550593 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.551252 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.552815 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.553269 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.553363 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.553371 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:38.553519 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 18:49:38.553567 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:49:38.553654 4919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.549928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:45353 (local address 127.12.202.194:41803)
0809 18:49:38.549990 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:38.550004 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:38.550053 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:38.550277 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:38.550278 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:38.550281 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:38.550371 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:38.550373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.551309 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.551310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:38.552667 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:38.552670 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.553360 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.553361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:38.553454 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.553457 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:49:38.553533 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 18:49:38.553575 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":57}
I20260809 18:49:38.553655 5150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.550044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:41803 (local address 127.12.202.195:45353)
0809 18:49:38.550119 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:38.550122 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:38.550132 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:49:38.550164 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:38.550164 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:38.550175 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:38.550256 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:38.550451 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.551212 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.552774 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.553267 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.553330 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.553338 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:38.553554 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 18:49:38.553594 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 18:49:38.553661 5163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.550064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:35865 (local address 127.12.202.194:53105)
0809 18:49:38.550252 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:38.550262 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:38.550315 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:38.550477 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:38.550478 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:38.550479 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:38.550526 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:38.550527 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.551321 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.551322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:38.552667 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:38.552670 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.553386 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.553387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:38.553447 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.553451 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:49:38.553493 (+ 42us) client_negotiation.cc:240] Negotiation successful
0809 18:49:38.553564 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":72,"thread_start_us":144,"threads_started":1}
I20260809 18:49:38.554104 5052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b5858a0c1bf4e1caf1962c660636f76" candidate_uuid: "c1c7551fc6f54728b81f347019c13ab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1027e06aff924da7a054f5aae187c984" is_pre_election: true
I20260809 18:49:38.554092 4609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b5858a0c1bf4e1caf1962c660636f76" candidate_uuid: "c1c7551fc6f54728b81f347019c13ab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad613925df94b71838b2ca6332dea9e" is_pre_election: true
I20260809 18:49:38.554270 5052 raft_consensus.cc:2454] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1c7551fc6f54728b81f347019c13ab1 in term 0.
I20260809 18:49:38.554270 4609 raft_consensus.cc:2454] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1c7551fc6f54728b81f347019c13ab1 in term 0.
I20260809 18:49:38.554514 4726 leader_election.cc:302] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1027e06aff924da7a054f5aae187c984, c1c7551fc6f54728b81f347019c13ab1; no voters:
I20260809 18:49:38.554641 5162 raft_consensus.cc:2781] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:49:38.554733 5162 raft_consensus.cc:482] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:49:38.554769 5162 raft_consensus.cc:3037] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:38.555595 5162 raft_consensus.cc:504] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } }
I20260809 18:49:38.555739 5162 leader_election.cc:288] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [CANDIDATE]: Term 1 election: Requested vote from peers 1027e06aff924da7a054f5aae187c984 (127.12.202.195:45353), 9ad613925df94b71838b2ca6332dea9e (127.12.202.193:35865)
I20260809 18:49:38.555989 5052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b5858a0c1bf4e1caf1962c660636f76" candidate_uuid: "c1c7551fc6f54728b81f347019c13ab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1027e06aff924da7a054f5aae187c984"
I20260809 18:49:38.555989 4609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b5858a0c1bf4e1caf1962c660636f76" candidate_uuid: "c1c7551fc6f54728b81f347019c13ab1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad613925df94b71838b2ca6332dea9e"
I20260809 18:49:38.556075 4609 raft_consensus.cc:3037] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:38.556077 5052 raft_consensus.cc:3037] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:38.557102 5052 raft_consensus.cc:2454] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c7551fc6f54728b81f347019c13ab1 in term 1.
I20260809 18:49:38.557308 4726 leader_election.cc:302] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1027e06aff924da7a054f5aae187c984, c1c7551fc6f54728b81f347019c13ab1; no voters:
I20260809 18:49:38.557420 5162 raft_consensus.cc:2781] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:49:38.557530 4609 raft_consensus.cc:2454] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1c7551fc6f54728b81f347019c13ab1 in term 1.
I20260809 18:49:38.557592 5162 raft_consensus.cc:686] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [term 1 LEADER]: Becoming Leader. State: Replica: c1c7551fc6f54728b81f347019c13ab1, State: Running, Role: LEADER
I20260809 18:49:38.557838 5162 consensus_queue.cc:237] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } }
I20260809 18:49:38.558670 4370 catalog_manager.cc:5495] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1c7551fc6f54728b81f347019c13ab1 (127.12.202.194). New cstate: current_term: 1 leader_uuid: "c1c7551fc6f54728b81f347019c13ab1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } health_report { overall_health: UNKNOWN } } }
W20260809 18:49:38.563243 5134 tablet.cc:2369] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:49:38.566340 5146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.563948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50256 (local address 127.12.202.194:34635)
0809 18:49:38.564014 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:38.564016 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:38.564026 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:49:38.564095 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:38.564095 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:38.564113 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:38.564191 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:49:38.564346 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.564869 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.565588 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:38.565781 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:38.565853 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:38.566017 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:49:38.566113 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:49:38.566194 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:38.566231 (+ 37us) server_negotiation.cc:299] Negotiation successful
0809 18:49:38.566251 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 18:49:38.568069 4609 raft_consensus.cc:1261] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Refusing update from remote peer c1c7551fc6f54728b81f347019c13ab1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:49:38.568069 5052 raft_consensus.cc:1261] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984 [term 1 FOLLOWER]: Refusing update from remote peer c1c7551fc6f54728b81f347019c13ab1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:49:38.568446 5164 consensus_queue.cc:1035] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:49:38.568594 5162 consensus_queue.cc:1035] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:49:38.570393 5169 mvcc.cc:205] Tried to move back new op lower bound from 7316690446612123648 to 7316690446573445120. Current Snapshot: MvccSnapshot[applied={T|T < 7316690446612123648}]
I20260809 18:49:38.570938 5171 mvcc.cc:205] Tried to move back new op lower bound from 7316690446612123648 to 7316690446573445120. Current Snapshot: MvccSnapshot[applied={T|T < 7316690446612123648}]
I20260809 18:49:38.572850 4369 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:50680:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:49:38.572966 4369 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:50680:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:49:38.573704 4369 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be: Sending DeleteTablet for 3 replicas of tablet 9b5858a0c1bf4e1caf1962c660636f76
I20260809 18:49:38.574044 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 4443
I20260809 18:49:38.574059 5014 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b5858a0c1bf4e1caf1962c660636f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:49:38 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:54824
I20260809 18:49:38.574139 4798 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b5858a0c1bf4e1caf1962c660636f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:49:38 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:50244
I20260809 18:49:38.574254 4575 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b5858a0c1bf4e1caf1962c660636f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:49:38 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:52416
I20260809 18:49:38.581400 5186 tablet_replica.cc:330] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1: stopping tablet replica
I20260809 18:49:38.581501 5186 raft_consensus.cc:2229] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:49:38.581584 5186 raft_consensus.cc:2258] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:49:38.582083 5186 ts_tablet_manager.cc:1905] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:49:38.584765 5186 ts_tablet_manager.cc:1918] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:49:38.584808 5185 tablet_replica.cc:330] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984: stopping tablet replica
I20260809 18:49:38.584930 5185 raft_consensus.cc:2229] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:49:38.584949 5186 log.cc:1196] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/9b5858a0c1bf4e1caf1962c660636f76
I20260809 18:49:38.585049 5185 raft_consensus.cc:2258] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:49:38.585399 5186 ts_tablet_manager.cc:1939] T 9b5858a0c1bf4e1caf1962c660636f76 P c1c7551fc6f54728b81f347019c13ab1: Deleting consensus metadata
I20260809 18:49:38.585515 5185 ts_tablet_manager.cc:1905] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:49:38.585943 4350 catalog_manager.cc:4841] TS c1c7551fc6f54728b81f347019c13ab1 (127.12.202.194:34635): tablet 9b5858a0c1bf4e1caf1962c660636f76 (table test-table [id=1f3dd696f2814baaafc140d490422b8d]) successfully deleted
I20260809 18:49:38.587129 5185 ts_tablet_manager.cc:1918] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:49:38.587208 5185 log.cc:1196] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/9b5858a0c1bf4e1caf1962c660636f76
I20260809 18:49:38.587513 5185 ts_tablet_manager.cc:1939] T 9b5858a0c1bf4e1caf1962c660636f76 P 1027e06aff924da7a054f5aae187c984: Deleting consensus metadata
I20260809 18:49:38.587958 4350 catalog_manager.cc:4841] TS 1027e06aff924da7a054f5aae187c984 (127.12.202.195:45353): tablet 9b5858a0c1bf4e1caf1962c660636f76 (table test-table [id=1f3dd696f2814baaafc140d490422b8d]) successfully deleted
W20260809 18:49:38.589617 4350 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.202.193:35865 (error 108)
I20260809 18:49:38.589929 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 4686
I20260809 18:49:38.590145 4692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.590010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:35865 (local address 127.0.0.1:52432)
0809 18:49:38.590065 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:38.590108 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:35865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 18:49:38.618680 4350 catalog_manager.cc:4584] TS 9ad613925df94b71838b2ca6332dea9e (127.12.202.193:35865): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9b5858a0c1bf4e1caf1962c660636f76: Network error: Client connection negotiation failed: client connection to 127.12.202.193:35865: connect: Connection refused (error 111)
I20260809 18:49:38.623220 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 4921
I20260809 18:49:38.635023 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 4322
I20260809 18:49:38.649044 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:36755
--webserver_interface=127.12.202.254
--webserver_port=41595
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:39379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:36755
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:49:38.730293 5188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:38.730494 5188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:38.730516 5188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:38.731681 5188 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:49:38.731722 5188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:38.731736 5188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:38.731750 5188 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:49:38.731801 5188 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:49:38.733268 5188 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:39379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:36755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:36755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=41595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:38.733536 5188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:38.733770 5188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:38.738615 5198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:38.738610 5201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:38.738610 5197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:38.738907 5188 server_base.cc:1034] running on GCE node
I20260809 18:49:38.739118 5188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:38.739396 5188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:38.740556 5188 hybrid_clock.cc:648] HybridClock initialized: now 1786301378740536 us; error 31 us; skew 500 ppm
Aug 09 18:49:38 dist-test-slave-45dx krb5kdc[3403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301378, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:38.743006 5188 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:49:38.743454 5188 webserver.cc:460] Webserver started at http://127.12.202.254:41595/ using document root <none> and password file <none>
I20260809 18:49:38.743743 5188 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:38.743816 5188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:38.745257 5188 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:49:38.745944 5211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:38.746117 5188 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:49:38.746230 5188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "84fa4b3bdbfe43cab589fa702a7242be"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "24cf8ae680e9591aa3009c702759e87a"
server_key_iv: "401bd64878d42433e32fe9b0fe506eaf"
server_key_version: "encryptionkey@0"
I20260809 18:49:38.746610 5188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:38.773850 5188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:38.776235 5188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:38.776437 5188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:38.780586 5188 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:36755
I20260809 18:49:38.780627 5305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:36755 every 8 connection(s)
I20260809 18:49:38.781013 5188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:49:38.782568 5307 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:49:38.783254 5307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be: Bootstrap starting.
I20260809 18:49:38.784433 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 5188
I20260809 18:49:38.784767 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:35865
--local_ip_for_outbound_sockets=127.12.202.193
--tserver_master_addrs=127.12.202.254:36755
--webserver_port=42655
--webserver_interface=127.12.202.193
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:39379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:49:38.793286 5307 log.cc:824] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:38.795509 5307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:49:38.795856 5307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be: Bootstrap complete.
I20260809 18:49:38.798214 5307 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fa4b3bdbfe43cab589fa702a7242be" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36755 } }
I20260809 18:49:38.798427 5307 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84fa4b3bdbfe43cab589fa702a7242be, State: Initialized, Role: FOLLOWER
I20260809 18:49:38.798596 5307 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fa4b3bdbfe43cab589fa702a7242be" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36755 } }
I20260809 18:49:38.798659 5307 raft_consensus.cc:388] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:49:38.798705 5307 raft_consensus.cc:482] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:49:38.798753 5307 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 2 FOLLOWER]: Advancing to term 3
I20260809 18:49:38.799854 5307 raft_consensus.cc:504] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fa4b3bdbfe43cab589fa702a7242be" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36755 } }
I20260809 18:49:38.799970 5307 leader_election.cc:302] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84fa4b3bdbfe43cab589fa702a7242be; no voters:
I20260809 18:49:38.800172 5307 leader_election.cc:288] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 18:49:38.800207 5313 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 3 FOLLOWER]: Leader election won for term 3
I20260809 18:49:38.800341 5313 raft_consensus.cc:686] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [term 3 LEADER]: Becoming Leader. State: Replica: 84fa4b3bdbfe43cab589fa702a7242be, State: Running, Role: LEADER
I20260809 18:49:38.800457 5307 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:49:38.800439 5313 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fa4b3bdbfe43cab589fa702a7242be" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36755 } }
I20260809 18:49:38.800731 5313 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84fa4b3bdbfe43cab589fa702a7242be. Latest consensus state: current_term: 3 leader_uuid: "84fa4b3bdbfe43cab589fa702a7242be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fa4b3bdbfe43cab589fa702a7242be" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36755 } } }
I20260809 18:49:38.800803 5313 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [sys.catalog]: This master's current role is: LEADER
I20260809 18:49:38.801035 5314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "84fa4b3bdbfe43cab589fa702a7242be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84fa4b3bdbfe43cab589fa702a7242be" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36755 } } }
I20260809 18:49:38.801115 5314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84fa4b3bdbfe43cab589fa702a7242be [sys.catalog]: This master's current role is: LEADER
I20260809 18:49:38.801316 5319 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:49:38.802176 5319 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:49:38.802284 5319 catalog_manager.cc:1259] Loaded cluster ID: 6ffc4acf2df94a4dba43a2cb687b6d2d
I20260809 18:49:38.802320 5319 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 18:49:38.802626 5319 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f829b0cb9ad google::LogMessage::Fail() at ??:0
@ 0x7f829b0ce88a google::LogMessage::SendToLog() at ??:0
@ 0x7f829b0cb4de google::LogMessage::Flush() at ??:0
@ 0x7f829b0cca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f82a2fec0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f82a2ff58b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f829cf990d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f829cf8e954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f829ddf26db start_thread at ??:0
@ 0x7f8299bc961f clone at ??:0
W20260809 18:49:38.881412 5310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:38.881603 5310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:38.881625 5310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:38.883230 5310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:38.883291 5310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:38.883337 5310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:49:38.884899 5310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:39379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:35865
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=42655
--tserver_master_addrs=127.12.202.254:36755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:38.885140 5310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:38.885375 5310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:38.890851 5369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:38.890846 5368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:38.890890 5372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:38.891125 5310 server_base.cc:1034] running on GCE node
I20260809 18:49:38.891328 5310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:38.891605 5310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:38.892819 5310 hybrid_clock.cc:648] HybridClock initialized: now 1786301378892804 us; error 29 us; skew 500 ppm
Aug 09 18:49:38 dist-test-slave-45dx krb5kdc[3403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301378, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:38.896345 5310 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:49:38.896811 5310 webserver.cc:460] Webserver started at http://127.12.202.193:42655/ using document root <none> and password file <none>
I20260809 18:49:38.897068 5310 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:38.897137 5310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:38.898540 5310 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:49:38.899297 5383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:38.899477 5310 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:49:38.899572 5310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "9ad613925df94b71838b2ca6332dea9e"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "3d09d84412e10eb1b1cab64f0c5ab72e"
server_key_iv: "382415d86eb91d734f940049a56b8d4b"
server_key_version: "encryptionkey@0"
I20260809 18:49:38.899917 5310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:38.925519 5310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:38.928048 5310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:38.928213 5310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:38.928499 5310 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:49:38.928985 5396 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 18:49:38.931119 5310 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 18:49:38.931180 5310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 18:49:38.931238 5310 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 18:49:38.931897 5310 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 18:49:38.931955 5310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 18:49:38.932039 5396 tablet_bootstrap.cc:492] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e: Bootstrap starting.
I20260809 18:49:38.939293 5310 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:35865
I20260809 18:49:38.939458 5576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:35865 every 8 connection(s)
I20260809 18:49:38.939724 5310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:49:38.941529 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 5310
I20260809 18:49:38.941833 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:34635
--local_ip_for_outbound_sockets=127.12.202.194
--tserver_master_addrs=127.12.202.254:36755
--webserver_port=38205
--webserver_interface=127.12.202.194
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:39379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:49:38.943488 5396 log.cc:824] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:38.946280 5396 tablet_bootstrap.cc:492] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:49:38.946633 5396 tablet_bootstrap.cc:492] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e: Bootstrap complete.
I20260809 18:49:38.947901 5396 ts_tablet_manager.cc:1397] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e: Time spent bootstrapping tablet: real 0.016s user 0.014s sys 0.000s
I20260809 18:49:38.949244 5396 raft_consensus.cc:348] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } }
I20260809 18:49:38.949551 5396 raft_consensus.cc:729] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad613925df94b71838b2ca6332dea9e, State: Initialized, Role: FOLLOWER
I20260809 18:49:38.949692 5396 consensus_queue.cc:260] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } }
I20260809 18:49:38.950001 5396 ts_tablet_manager.cc:1428] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260809 18:49:38.998898 5579 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:49:38.940496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:38771)
0809 18:49:38.940679 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:38.940723 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:38.941169 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:38.998666 (+ 57497us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":107,"threads_started":1}
W20260809 18:49:38.999174 5577 heartbeater.cc:644] Failed to heartbeat to 127.12.202.254:36755 (0 consecutive failures): Network error: Failed to ping master at 127.12.202.254:36755: Client connection negotiation failed: client connection to 127.12.202.254:36755: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 18:49:38.999639 5579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.999461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:34813)
0809 18:49:38.999545 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:38.999609 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 18:49:39.000068 5579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:38.999956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:37213)
0809 18:49:39.000005 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:39.000045 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 18:49:39.000193 5577 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 18:49:39.030381 5580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:39.030613 5580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:39.030655 5580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:39.031807 5580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:39.031878 5580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:39.031924 5580 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:49:39.033442 5580 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:39379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:34635
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=38205
--tserver_master_addrs=127.12.202.254:36755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:39.033702 5580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:39.033928 5580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:39.039119 5594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:39.039198 5580 server_base.cc:1034] running on GCE node
W20260809 18:49:39.039125 5597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:39.039137 5595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:39.039572 5580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:39.039827 5580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:39.040972 5580 hybrid_clock.cc:648] HybridClock initialized: now 1786301379040960 us; error 29 us; skew 500 ppm
Aug 09 18:49:39 dist-test-slave-45dx krb5kdc[3403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301379, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:39.043655 5580 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:49:39.044129 5580 webserver.cc:460] Webserver started at http://127.12.202.194:38205/ using document root <none> and password file <none>
I20260809 18:49:39.044416 5580 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:39.044467 5580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:39.045790 5580 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:49:39.046413 5607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:39.046599 5580 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:49:39.046711 5580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "c1c7551fc6f54728b81f347019c13ab1"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "8a840394d130d8aa73029672b91e8f89"
server_key_iv: "b8bb96c5b503a31863b3fda320559387"
server_key_version: "encryptionkey@0"
I20260809 18:49:39.047066 5580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:39.055382 5580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:39.057713 5580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:39.057876 5580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:39.058104 5580 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:49:39.058406 5580 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:49:39.058462 5580 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:39.058503 5580 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:49:39.058533 5580 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:39.066933 5580 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:34635
I20260809 18:49:39.067015 5786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:34635 every 8 connection(s)
I20260809 18:49:39.067409 5580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:49:39.068459 5789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:39.068027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:38591)
0809 18:49:39.068182 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:39.068259 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":79,"threads_started":1}
W20260809 18:49:39.068848 5787 heartbeater.cc:644] Failed to heartbeat to 127.12.202.254:36755 (0 consecutive failures): Network error: Failed to ping master at 127.12.202.254:36755: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
I20260809 18:49:39.069149 5789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:39.069062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:39543)
0809 18:49:39.069105 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:39.069132 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 18:49:39.069473 5789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:39.069385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:53485)
0809 18:49:39.069429 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:39.069457 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 18:49:39.069578 5787 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 18:49:39.069701 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 5580
I20260809 18:49:39.069964 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:45353
--local_ip_for_outbound_sockets=127.12.202.195
--tserver_master_addrs=127.12.202.254:36755
--webserver_port=37941
--webserver_interface=127.12.202.195
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:39379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:49:39.152714 5791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:39.152913 5791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:39.152937 5791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:39.154089 5791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:39.154131 5791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:39.154191 5791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:49:39.155597 5791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:39379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:45353
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=37941
--tserver_master_addrs=127.12.202.254:36755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:39.155833 5791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:39.156060 5791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:39.161098 5799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:39.161099 5800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:39.161111 5803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:39.161332 5791 server_base.cc:1034] running on GCE node
I20260809 18:49:39.161541 5791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:39.161787 5791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:39.162963 5791 hybrid_clock.cc:648] HybridClock initialized: now 1786301379162948 us; error 32 us; skew 500 ppm
Aug 09 18:49:39 dist-test-slave-45dx krb5kdc[3403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301379, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:39.165652 5791 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:49:39.166095 5791 webserver.cc:460] Webserver started at http://127.12.202.195:37941/ using document root <none> and password file <none>
I20260809 18:49:39.166268 5791 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:39.166307 5791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:39.167624 5791 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:49:39.168165 5811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:39.168360 5791 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:49:39.168453 5791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "1027e06aff924da7a054f5aae187c984"
format_stamp: "Formatted at 2026-08-09 18:49:37 on dist-test-slave-45dx"
server_key: "9eb611361addaa05315e039d31bb0389"
server_key_iv: "c30214c2c9ffb1b9f6568f03c620ba93"
server_key_version: "encryptionkey@0"
I20260809 18:49:39.168727 5791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:39.181105 5791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:39.182870 5791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:39.182976 5791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:39.183140 5791 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:49:39.183445 5791 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:49:39.183480 5791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:39.183501 5791 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:49:39.183547 5791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:39.189342 5791 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:45353
I20260809 18:49:39.189417 5983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:45353 every 8 connection(s)
I20260809 18:49:39.189776 5791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:49:39.190897 5988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:39.190502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:46701)
0809 18:49:39.190667 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:39.190748 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":70,"threads_started":1}
W20260809 18:49:39.191335 5986 heartbeater.cc:644] Failed to heartbeat to 127.12.202.254:36755 (0 consecutive failures): Network error: Failed to ping master at 127.12.202.254:36755: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
I20260809 18:49:39.191687 5988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:39.191576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:32935)
0809 18:49:39.191639 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:39.191668 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 18:49:39.192103 5988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:39.191961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:49663)
0809 18:49:39.192034 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:39.192063 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 18:49:39.192203 5986 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 18:49:39.195825 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 5791
I20260809 18:49:40.000917 5991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:40.000650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:55275)
0809 18:49:40.000806 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:40.000862 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":63,"threads_started":1}
I20260809 18:49:40.070101 5994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:40.069894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:59335)
0809 18:49:40.070011 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:40.070048 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":59,"threads_started":1}
I20260809 18:49:40.192798 5996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:40.192538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:43199)
0809 18:49:40.192694 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:40.192732 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":61,"threads_started":1}
I20260809 18:49:40.314121 5997 raft_consensus.cc:482] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:49:40.314256 5997 raft_consensus.cc:504] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } }
I20260809 18:49:40.314659 5997 leader_election.cc:288] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c1c7551fc6f54728b81f347019c13ab1 (127.12.202.194:34635), 1027e06aff924da7a054f5aae187c984 (127.12.202.195:45353)
Aug 09 18:49:40 dist-test-slave-45dx krb5kdc[3403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301378, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.194@KRBTEST.COM
Aug 09 18:49:40 dist-test-slave-45dx krb5kdc[3403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301378, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.195@KRBTEST.COM
I20260809 18:49:40.327474 6001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:40.315187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:60239 (local address 127.12.202.195:45353)
0809 18:49:40.315344 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:40.315351 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:40.315385 (+ 34us) server_negotiation.cc:407] Connection header received
0809 18:49:40.315889 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:40.315891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:40.315939 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:40.316102 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:40.316936 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:40.318343 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:40.319866 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:40.320516 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:40.320634 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:40.323710 (+ 3076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:40.323714 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:40.323714 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:40.323733 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:40.325575 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:40.326010 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:40.326012 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:40.326013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:40.326140 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:40.326466 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:40.326467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:40.326468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:40.326776 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:40.326867 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:40.327223 (+ 356us) server_negotiation.cc:299] Negotiation successful
0809 18:49:40.327356 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":51,"threads_started":1}
I20260809 18:49:40.327474 5998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:40.315008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:34637 (local address 127.12.202.194:34635)
0809 18:49:40.315196 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:40.315205 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:40.315241 (+ 36us) server_negotiation.cc:407] Connection header received
0809 18:49:40.315741 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:40.315744 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:40.315801 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:40.315952 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:40.316936 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:40.318342 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:40.319853 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:40.320515 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:40.320634 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:40.323350 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:40.323353 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:40.323354 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:40.323364 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:40.325413 (+ 2049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:40.326010 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:40.326012 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:40.326013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:40.326140 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:40.326550 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:40.326551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:40.326551 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:40.326799 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:40.326887 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:40.327223 (+ 336us) server_negotiation.cc:299] Negotiation successful
0809 18:49:40.327356 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":81,"threads_started":1}
I20260809 18:49:40.327505 5999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:40.315064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:45353 (local address 127.12.202.193:60239)
0809 18:49:40.315187 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:40.315198 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:40.315248 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:40.316081 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:40.316083 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:40.316534 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:40.316797 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:40.316804 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:40.318458 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:40.318459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:40.319756 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:40.319759 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:40.320620 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:40.320622 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:40.320790 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:40.321445 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:40.321449 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:40.323606 (+ 2157us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:40.325648 (+ 2042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:40.325648 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:40.325649 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:40.325924 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:40.326214 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:40.326215 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:40.326215 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:40.326377 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:40.326857 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:40.326866 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:40.327029 (+ 163us) client_negotiation.cc:769] Sending connection context
0809 18:49:40.327150 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 18:49:40.327362 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":51,"thread_start_us":67,"threads_started":1}
I20260809 18:49:40.327518 5991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:40.314900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:34635 (local address 127.12.202.193:34637)
0809 18:49:40.314972 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:40.314987 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:40.315063 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:40.315997 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:40.316000 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:40.316536 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:40.316797 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:40.316804 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:40.318468 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:40.318469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:40.319756 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:40.319759 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:40.320622 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:40.320623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:40.320790 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:40.321419 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:40.321431 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:40.323225 (+ 1794us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:40.325495 (+ 2270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:40.325502 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:40.325504 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:40.325924 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:40.326214 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:40.326215 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:40.326215 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:40.326377 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:40.326873 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:40.326874 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:40.327029 (+ 155us) client_negotiation.cc:769] Sending connection context
0809 18:49:40.327151 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 18:49:40.327407 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":203}
W20260809 18:49:40.328353 5388 leader_election.cc:341] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c1c7551fc6f54728b81f347019c13ab1 (127.12.202.194:34635): Not found: Tablet not found: 9b5858a0c1bf4e1caf1962c660636f76
W20260809 18:49:40.328845 5388 leader_election.cc:341] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1027e06aff924da7a054f5aae187c984 (127.12.202.195:45353): Not found: Tablet not found: 9b5858a0c1bf4e1caf1962c660636f76
I20260809 18:49:40.328895 5388 leader_election.cc:302] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ad613925df94b71838b2ca6332dea9e; no voters: 1027e06aff924da7a054f5aae187c984, c1c7551fc6f54728b81f347019c13ab1
I20260809 18:49:40.329012 5997 raft_consensus.cc:2726] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:49:41.001705 6002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:41.001492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:50859)
0809 18:49:41.001619 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:41.001654 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":67,"threads_started":1}
I20260809 18:49:41.070817 6004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:41.070596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:45587)
0809 18:49:41.070741 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:41.070777 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":93,"threads_started":1}
I20260809 18:49:41.193650 6005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:41.193429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:33721)
0809 18:49:41.193560 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:41.193602 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":66,"threads_started":1}
I20260809 18:49:41.839052 6006 raft_consensus.cc:482] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:49:41.839166 6006 raft_consensus.cc:504] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } }
I20260809 18:49:41.839367 6006 leader_election.cc:288] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c1c7551fc6f54728b81f347019c13ab1 (127.12.202.194:34635), 1027e06aff924da7a054f5aae187c984 (127.12.202.195:45353)
W20260809 18:49:41.839884 5388 leader_election.cc:341] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c1c7551fc6f54728b81f347019c13ab1 (127.12.202.194:34635): Not found: Tablet not found: 9b5858a0c1bf4e1caf1962c660636f76
W20260809 18:49:41.839986 5388 leader_election.cc:341] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1027e06aff924da7a054f5aae187c984 (127.12.202.195:45353): Not found: Tablet not found: 9b5858a0c1bf4e1caf1962c660636f76
I20260809 18:49:41.840021 5388 leader_election.cc:302] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ad613925df94b71838b2ca6332dea9e; no voters: 1027e06aff924da7a054f5aae187c984, c1c7551fc6f54728b81f347019c13ab1
I20260809 18:49:41.840116 6006 raft_consensus.cc:2726] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:49:42.002521 6007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:42.002228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:49325)
0809 18:49:42.002426 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:42.002469 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":92,"threads_started":1}
I20260809 18:49:42.071403 6008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:42.071193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:46709)
0809 18:49:42.071329 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:42.071363 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":78,"threads_started":1}
I20260809 18:49:42.194347 6010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:42.194140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:44319)
0809 18:49:42.194264 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:42.194302 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":62,"threads_started":1}
I20260809 18:49:43.003219 6011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:43.003001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:32811)
0809 18:49:43.003131 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:43.003169 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":68,"threads_started":1}
I20260809 18:49:43.073987 6012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:43.071820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:48913)
0809 18:49:43.073862 (+ 2042us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:43.073928 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2026,"thread_start_us":2000,"threads_started":1}
I20260809 18:49:43.195044 6014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:43.194788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:40889)
0809 18:49:43.194957 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:43.194997 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":81,"threads_started":1}
I20260809 18:49:44.004034 6015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:44.003774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:44475)
0809 18:49:44.003935 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:44.003980 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":66,"threads_started":1}
I20260809 18:49:44.074627 6017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:44.074418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:45637)
0809 18:49:44.074547 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:44.074582 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":65,"threads_started":1}
I20260809 18:49:44.195832 6019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:44.195596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:56427)
0809 18:49:44.195742 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:44.195782 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":98,"threads_started":1}
I20260809 18:49:44.415647 6020 raft_consensus.cc:482] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:49:44.415792 6020 raft_consensus.cc:504] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } }
I20260809 18:49:44.416033 6020 leader_election.cc:288] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c1c7551fc6f54728b81f347019c13ab1 (127.12.202.194:34635), 1027e06aff924da7a054f5aae187c984 (127.12.202.195:45353)
W20260809 18:49:44.416385 5388 leader_election.cc:341] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c1c7551fc6f54728b81f347019c13ab1 (127.12.202.194:34635): Not found: Tablet not found: 9b5858a0c1bf4e1caf1962c660636f76
W20260809 18:49:44.416471 5388 leader_election.cc:341] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1027e06aff924da7a054f5aae187c984 (127.12.202.195:45353): Not found: Tablet not found: 9b5858a0c1bf4e1caf1962c660636f76
I20260809 18:49:44.416494 5388 leader_election.cc:302] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ad613925df94b71838b2ca6332dea9e; no voters: 1027e06aff924da7a054f5aae187c984, c1c7551fc6f54728b81f347019c13ab1
I20260809 18:49:44.416567 6020 raft_consensus.cc:2726] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:49:45.004798 6023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:45.004533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:59589)
0809 18:49:45.004699 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:45.004738 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":84,"threads_started":1}
I20260809 18:49:45.075382 6026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:45.075131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:56681)
0809 18:49:45.075291 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:45.075333 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":83,"threads_started":1}
I20260809 18:49:45.196658 6028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:45.196423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:44991)
0809 18:49:45.196571 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:45.196609 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":64,"threads_started":1}
I20260809 18:49:46.005479 6029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:46.005241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:49717)
0809 18:49:46.005392 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:46.005431 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":70,"threads_started":1}
I20260809 18:49:46.076131 6031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:46.075854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:49697)
0809 18:49:46.076046 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:46.076085 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":109,"threads_started":1}
I20260809 18:49:46.197402 6032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:46.197152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:58353)
0809 18:49:46.197316 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:46.197353 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":81,"threads_started":1}
I20260809 18:49:47.006141 6033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:47.005916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:55807)
0809 18:49:47.006058 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:47.006091 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":81,"threads_started":1}
I20260809 18:49:47.076789 6034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:47.076600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:44571)
0809 18:49:47.076714 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:47.076751 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":60,"threads_started":1}
I20260809 18:49:47.198083 6037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:47.197852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:52997)
0809 18:49:47.198009 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:47.198039 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":80,"threads_started":1}
I20260809 18:49:48.006784 6038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:48.006566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:34739)
0809 18:49:48.006701 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:48.006735 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":76,"threads_started":1}
I20260809 18:49:48.077389 6039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:48.077178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:42505)
0809 18:49:48.077302 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:48.077338 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":56,"threads_started":1}
I20260809 18:49:48.198726 6041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:48.198522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:56139)
0809 18:49:48.198652 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:48.198684 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":77,"threads_started":1}
I20260809 18:49:48.827123 6042 raft_consensus.cc:482] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:49:48.827244 6042 raft_consensus.cc:504] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1c7551fc6f54728b81f347019c13ab1" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 34635 } } peers { permanent_uuid: "1027e06aff924da7a054f5aae187c984" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45353 } } peers { permanent_uuid: "9ad613925df94b71838b2ca6332dea9e" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 35865 } }
I20260809 18:49:48.827425 6042 leader_election.cc:288] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c1c7551fc6f54728b81f347019c13ab1 (127.12.202.194:34635), 1027e06aff924da7a054f5aae187c984 (127.12.202.195:45353)
W20260809 18:49:48.827788 5388 leader_election.cc:341] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c1c7551fc6f54728b81f347019c13ab1 (127.12.202.194:34635): Not found: Tablet not found: 9b5858a0c1bf4e1caf1962c660636f76
W20260809 18:49:48.827879 5388 leader_election.cc:341] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1027e06aff924da7a054f5aae187c984 (127.12.202.195:45353): Not found: Tablet not found: 9b5858a0c1bf4e1caf1962c660636f76
I20260809 18:49:48.827921 5388 leader_election.cc:302] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ad613925df94b71838b2ca6332dea9e; no voters: 1027e06aff924da7a054f5aae187c984, c1c7551fc6f54728b81f347019c13ab1
I20260809 18:49:48.828034 6042 raft_consensus.cc:2726] T 9b5858a0c1bf4e1caf1962c660636f76 P 9ad613925df94b71838b2ca6332dea9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:49:49.007592 6043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:49.007310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:41347)
0809 18:49:49.007497 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:49.007540 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":92,"threads_started":1}
I20260809 18:49:49.078024 6045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:49.077791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:51443)
0809 18:49:49.077928 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:49.077960 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":83,"threads_started":1}
I20260809 18:49:49.199527 6046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:49.199269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:48507)
0809 18:49:49.199420 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:49.199459 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":88,"threads_started":1}
I20260809 18:49:50.008384 6048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:50.008077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:50573)
0809 18:49:50.008229 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:50.008269 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":67,"threads_started":1}
I20260809 18:49:50.078732 6051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:50.078486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:57815)
0809 18:49:50.078641 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:50.078683 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":67,"threads_started":1}
I20260809 18:49:50.200266 6052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:50.200021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:55731)
0809 18:49:50.200171 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:50.200213 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":66,"threads_started":1}
I20260809 18:49:51.009109 6054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:51.008866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:59303)
0809 18:49:51.009009 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:51.009054 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":73,"threads_started":1}
I20260809 18:49:51.079357 6056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:51.079162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:57073)
0809 18:49:51.079272 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:51.079304 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":54,"threads_started":1}
I20260809 18:49:51.201119 6058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:51.200890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:48031)
0809 18:49:51.201022 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:51.201066 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":72,"threads_started":1}
I20260809 18:49:52.009877 6059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:52.009636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:57939)
0809 18:49:52.009787 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:52.009828 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":65,"threads_started":1}
I20260809 18:49:52.080081 6061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:52.079847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:44845)
0809 18:49:52.079981 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:52.080024 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":65,"threads_started":1}
I20260809 18:49:52.201879 6064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:52.201614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:56313)
0809 18:49:52.201762 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:52.201819 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":82,"threads_started":1}
I20260809 18:49:53.010593 6066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:53.010308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:51165)
0809 18:49:53.010499 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:53.010544 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":60,"threads_started":1}
I20260809 18:49:53.080789 6068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:53.080569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:48863)
0809 18:49:53.080703 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:53.080741 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":66,"threads_started":1}
I20260809 18:49:53.202589 6069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:53.202348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:60991)
0809 18:49:53.202484 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:53.202522 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":80,"threads_started":1}
I20260809 18:49:54.011423 6070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:54.011180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.193:58285)
0809 18:49:54.011327 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:54.011371 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":81,"threads_started":1}
I20260809 18:49:54.081548 6071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:54.081318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.194:35277)
0809 18:49:54.081465 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:54.081497 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":94,"threads_started":1}
I20260809 18:49:54.202474 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 5310
I20260809 18:49:54.209201 6073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:54.208891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36755 (local address 127.12.202.195:50585)
0809 18:49:54.209095 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:54.209141 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:36755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":56,"threads_started":1}
I20260809 18:49:54.214694 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 5580
I20260809 18:49:54.228241 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 5791
2026-08-09T18:49:54Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18676 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:49:54 dist-test-slave-45dx krb5kdc[6077](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:49:54 dist-test-slave-45dx krb5kdc[6077](info): set up 2 sockets
Aug 09 18:49:54 dist-test-slave-45dx krb5kdc[6077](info): commencing operation
krb5kdc: starting...
W20260809 18:49:55.561602 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:49:55 dist-test-slave-45dx krb5kdc[6077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301395, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:49:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:49:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:49:55.685421 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:45899
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:45899
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:49:55.767155 6092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:55.767400 6092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:55.767438 6092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:55.768675 6092 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 18:49:55.768746 6092 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 18:49:55.768767 6092 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 18:49:55.768786 6092 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:49:55.768815 6092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:55.768846 6092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:55.768872 6092 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:49:55.768905 6092 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:49:55.770430 6092 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:45899
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:45899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:55.770711 6092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:55.770959 6092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:55.776088 6099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:55.776149 6092 server_base.cc:1034] running on GCE node
W20260809 18:49:55.776104 6101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:55.776095 6105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:55.776657 6092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:55.777004 6092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:55.778162 6092 hybrid_clock.cc:648] HybridClock initialized: now 1786301395778147 us; error 39 us; skew 500 ppm
Aug 09 18:49:55 dist-test-slave-45dx krb5kdc[6077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301395, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:55.780897 6092 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:49:55.781365 6092 webserver.cc:460] Webserver started at http://127.12.202.254:41603/ using document root <none> and password file <none>
I20260809 18:49:55.781626 6092 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:55.781673 6092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:55.781855 6092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:49:55.782972 6092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "57c394e9c5594afc8ca1a25b6d893f8c"
format_stamp: "Formatted at 2026-08-09 18:49:55 on dist-test-slave-45dx"
server_key: "d618c76319f1760af3bd16f4df22a607"
server_key_iv: "2c94c32ea58224c35cc926e42983a9a0"
server_key_version: "encryptionkey@0"
I20260809 18:49:55.783352 6092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "57c394e9c5594afc8ca1a25b6d893f8c"
format_stamp: "Formatted at 2026-08-09 18:49:55 on dist-test-slave-45dx"
server_key: "d618c76319f1760af3bd16f4df22a607"
server_key_iv: "2c94c32ea58224c35cc926e42983a9a0"
server_key_version: "encryptionkey@0"
I20260809 18:49:55.784855 6092 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:49:55.785629 6121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:55.785804 6092 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:49:55.785893 6092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "57c394e9c5594afc8ca1a25b6d893f8c"
format_stamp: "Formatted at 2026-08-09 18:49:55 on dist-test-slave-45dx"
server_key: "d618c76319f1760af3bd16f4df22a607"
server_key_iv: "2c94c32ea58224c35cc926e42983a9a0"
server_key_version: "encryptionkey@0"
I20260809 18:49:55.785948 6092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:55.798000 6092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:55.799901 6092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:55.800028 6092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:55.804158 6092 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:45899
I20260809 18:49:55.804214 6197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:45899 every 8 connection(s)
I20260809 18:49:55.804561 6092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:49:55.805521 6201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:55.807689 6201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: Bootstrap starting.
I20260809 18:49:55.808229 6201 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:55.808555 6201 log.cc:824] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:55.809201 6201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: No bootstrap required, opened a new log
I20260809 18:49:55.810376 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 6092
I20260809 18:49:55.810491 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:49:55.810710 13099 external_mini_cluster.cc:1428] Setting key fc32ed4933db5c20d9973cdef5088c2d
I20260809 18:49:55.810922 6201 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45899 } }
I20260809 18:49:55.811091 6201 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:55.811129 6201 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57c394e9c5594afc8ca1a25b6d893f8c, State: Initialized, Role: FOLLOWER
I20260809 18:49:55.811290 6201 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45899 } }
I20260809 18:49:55.811420 6201 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:49:55.811468 6201 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:49:55.811510 6201 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:55.812338 6201 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45899 } }
I20260809 18:49:55.812456 6201 leader_election.cc:302] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57c394e9c5594afc8ca1a25b6d893f8c; no voters:
I20260809 18:49:55.812601 6201 leader_election.cc:288] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:49:55.812640 6207 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:49:55.812785 6207 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 1 LEADER]: Becoming Leader. State: Replica: 57c394e9c5594afc8ca1a25b6d893f8c, State: Running, Role: LEADER
I20260809 18:49:55.812877 6201 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:49:55.812904 6207 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45899 } }
I20260809 18:49:55.813449 6210 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45899 } } }
I20260809 18:49:55.813553 6210 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [sys.catalog]: This master's current role is: LEADER
I20260809 18:49:55.813445 6211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57c394e9c5594afc8ca1a25b6d893f8c. Latest consensus state: current_term: 1 leader_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45899 } } }
I20260809 18:49:55.813606 6211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [sys.catalog]: This master's current role is: LEADER
I20260809 18:49:55.814368 6221 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:49:55.814843 6221 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:49:55.817267 6221 catalog_manager.cc:1347] Generated new cluster ID: 767891e48a3d4e6c9a09ccf4b7ccaca2
I20260809 18:49:55.817332 6221 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:49:55 dist-test-slave-45dx krb5kdc[6077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301395, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:55.822278 6205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:55.811218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49454 (local address 127.12.202.254:45899)
0809 18:49:55.811397 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:55.811407 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:55.811443 (+ 36us) server_negotiation.cc:407] Connection header received
0809 18:49:55.811594 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:55.811600 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:55.811653 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:55.811788 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:55.812493 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:55.813885 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:55.814984 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:55.815580 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:55.815707 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:55.818349 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:55.818352 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:55.818353 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:55.818365 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:55.820485 (+ 2120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:55.820891 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:55.820894 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:55.820894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:55.821038 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:55.821257 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:55.821258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:55.821258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:55.821576 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:55.821848 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:55.821930 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 18:49:55.822074 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":98,"threads_started":1}
I20260809 18:49:55.834805 6221 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:49:55.835291 6221 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:49:55.841938 6221 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: Generated new TSK 0
I20260809 18:49:55.842113 6221 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
I20260809 18:49:55.871299 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:45899
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:49:55.954459 6241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:55.954667 6241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:55.954691 6241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:55.955875 6241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:55.955937 6241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:55.955967 6241 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:49:55.957461 6241 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:45899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:55.957737 6241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:55.957986 6241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:55.963174 6247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:55.963202 6259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:55.963202 6251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:55.963361 6241 server_base.cc:1034] running on GCE node
I20260809 18:49:55.963662 6241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:55.963968 6241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:55.965118 6241 hybrid_clock.cc:648] HybridClock initialized: now 1786301395965103 us; error 27 us; skew 500 ppm
Aug 09 18:49:55 dist-test-slave-45dx krb5kdc[6077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301395, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:55.967988 6241 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:49:55.968495 6241 webserver.cc:460] Webserver started at http://127.12.202.193:32993/ using document root <none> and password file <none>
I20260809 18:49:55.968729 6241 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:55.968782 6241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:55.968967 6241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:49:55.970098 6241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891"
format_stamp: "Formatted at 2026-08-09 18:49:55 on dist-test-slave-45dx"
server_key: "cf5269c2e3aa98b356b45b3721a2e1ee"
server_key_iv: "694b0f11f14e19ac0c777721ac99a86f"
server_key_version: "encryptionkey@0"
I20260809 18:49:55.970486 6241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891"
format_stamp: "Formatted at 2026-08-09 18:49:55 on dist-test-slave-45dx"
server_key: "cf5269c2e3aa98b356b45b3721a2e1ee"
server_key_iv: "694b0f11f14e19ac0c777721ac99a86f"
server_key_version: "encryptionkey@0"
I20260809 18:49:55.971944 6241 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:49:55.972879 6267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:55.973101 6241 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:49:55.973207 6241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891"
format_stamp: "Formatted at 2026-08-09 18:49:55 on dist-test-slave-45dx"
server_key: "cf5269c2e3aa98b356b45b3721a2e1ee"
server_key_iv: "694b0f11f14e19ac0c777721ac99a86f"
server_key_version: "encryptionkey@0"
I20260809 18:49:55.973285 6241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:56.003619 6241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:56.005699 6241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:56.005887 6241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:56.006160 6241 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:49:56.006525 6241 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:49:56.006561 6241 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:56.006583 6241 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:49:56.006595 6241 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:56.012452 6241 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:38733
I20260809 18:49:56.012501 6469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:38733 every 8 connection(s)
I20260809 18:49:56.012892 6241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:49:56.016836 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 6241
I20260809 18:49:56.016947 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:49:56.017218 13099 external_mini_cluster.cc:1428] Setting key e57843e8c980b2997c9e711d0b88cbc4
Aug 09 18:49:56 dist-test-slave-45dx krb5kdc[6077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301395, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:56.023599 6205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.013786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:58563 (local address 127.12.202.254:45899)
0809 18:49:56.013829 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:56.013856 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:56.014119 (+ 263us) server_negotiation.cc:407] Connection header received
0809 18:49:56.014658 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:56.014659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:56.014670 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:56.014724 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:56.015703 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.016291 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.017545 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.017891 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.017992 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:56.020202 (+ 2210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:56.020203 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:56.020204 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:56.020213 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:56.021937 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:56.022443 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:56.022444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:56.022444 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:56.022503 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:56.022823 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:56.022823 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:56.022823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:56.022966 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:56.023105 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:56.023441 (+ 336us) server_negotiation.cc:299] Negotiation successful
0809 18:49:56.023525 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 18:49:56.023877 6475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.013732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:58563)
0809 18:49:56.013973 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:56.014017 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:56.014563 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:56.014791 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:56.014795 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:56.015398 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:56.015590 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:56.015595 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.016397 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.016398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:56.017425 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:56.017428 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.017987 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.017988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:56.018120 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:56.018686 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:56.018695 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:56.020101 (+ 1406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:56.022025 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:56.022032 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:56.022034 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:56.022366 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:56.022574 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:56.022575 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:56.022576 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:56.022743 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:56.023055 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:56.023063 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:56.023280 (+ 217us) client_negotiation.cc:769] Sending connection context
0809 18:49:56.023404 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 18:49:56.023580 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":107,"threads_started":1}
I20260809 18:49:56.024472 6472 heartbeater.cc:347] Connected to a master server at 127.12.202.254:45899
I20260809 18:49:56.024570 6472 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:56.024801 6472 heartbeater.cc:511] Master 127.12.202.254:45899 requested a full tablet report, sending...
I20260809 18:49:56.025419 6142 ts_manager.cc:194] Registered new tserver with Master: 97b8b1f4e4234a799bfe7e1d6c3d0891 (127.12.202.193:38733)
I20260809 18:49:56.026100 6142 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:58563
WARNING: no policy specified for kudu/127.12.202.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
I20260809 18:49:56.047344 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:45899
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:49:56.135351 6480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:56.135613 6480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:56.135651 6480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:56.136770 6480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:56.136848 6480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:56.136895 6480 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:49:56.138366 6480 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:45899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6480
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:56.138631 6480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:56.138873 6480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:56.144095 6493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:56.144133 6491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:56.144091 6489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:56.144492 6480 server_base.cc:1034] running on GCE node
I20260809 18:49:56.144718 6480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:56.145009 6480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:56.146190 6480 hybrid_clock.cc:648] HybridClock initialized: now 1786301396146183 us; error 37 us; skew 500 ppm
Aug 09 18:49:56 dist-test-slave-45dx krb5kdc[6077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301396, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:56.149030 6480 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:49:56.149535 6480 webserver.cc:460] Webserver started at http://127.12.202.194:46289/ using document root <none> and password file <none>
I20260809 18:49:56.149787 6480 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:56.149863 6480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:56.150024 6480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:49:56.151126 6480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "83ad216d455340bf8a8a3e4332b6d5c6"
format_stamp: "Formatted at 2026-08-09 18:49:56 on dist-test-slave-45dx"
server_key: "634412cb2ea8dc871305d95e88b457f5"
server_key_iv: "69b1cb2d47ff8ca60498d46bf6bea99d"
server_key_version: "encryptionkey@0"
I20260809 18:49:56.151528 6480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "83ad216d455340bf8a8a3e4332b6d5c6"
format_stamp: "Formatted at 2026-08-09 18:49:56 on dist-test-slave-45dx"
server_key: "634412cb2ea8dc871305d95e88b457f5"
server_key_iv: "69b1cb2d47ff8ca60498d46bf6bea99d"
server_key_version: "encryptionkey@0"
I20260809 18:49:56.153103 6480 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:49:56.153919 6505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:56.154090 6480 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:49:56.154197 6480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "83ad216d455340bf8a8a3e4332b6d5c6"
format_stamp: "Formatted at 2026-08-09 18:49:56 on dist-test-slave-45dx"
server_key: "634412cb2ea8dc871305d95e88b457f5"
server_key_iv: "69b1cb2d47ff8ca60498d46bf6bea99d"
server_key_version: "encryptionkey@0"
I20260809 18:49:56.154302 6480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:56.171314 6480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:56.173694 6480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:56.173879 6480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:56.174131 6480 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:49:56.174489 6480 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:49:56.174556 6480 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:56.174608 6480 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:49:56.174635 6480 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:56.180943 6480 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:35769
I20260809 18:49:56.181015 6697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:35769 every 8 connection(s)
I20260809 18:49:56.181430 6480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:49:56.182860 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 6480
I20260809 18:49:56.183015 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:49:56.183241 13099 external_mini_cluster.cc:1428] Setting key 496e38e10482f6ad392ff374a29e7ddf
Aug 09 18:49:56 dist-test-slave-45dx krb5kdc[6077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301396, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:56.193463 6205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.182304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:33439 (local address 127.12.202.254:45899)
0809 18:49:56.182399 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:56.182402 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:56.182577 (+ 175us) server_negotiation.cc:407] Connection header received
0809 18:49:56.183394 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:56.183395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:56.183407 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:56.183470 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:56.184702 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.185457 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.187123 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.187330 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.187384 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:56.190362 (+ 2978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:56.190363 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:56.190363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:56.190371 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:56.191854 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:56.192416 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:56.192417 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:56.192417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:56.192484 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:56.192796 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:56.192797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:56.192797 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:56.192903 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:56.192952 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:56.193317 (+ 365us) server_negotiation.cc:299] Negotiation successful
0809 18:49:56.193395 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 18:49:56.193799 6700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.182265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:33439)
0809 18:49:56.182439 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:56.182485 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:56.183259 (+ 774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:56.183553 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:56.183558 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:56.184378 (+ 820us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:56.184604 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:56.184610 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.185583 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.185584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:56.187008 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:56.187012 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.187401 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.187402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:56.187561 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:56.188235 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:56.188246 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:56.190255 (+ 2009us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:56.191946 (+ 1691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:56.191956 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:56.191959 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:56.192330 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:56.192558 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:56.192559 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:56.192560 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:56.192719 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:56.192973 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:56.192980 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:56.193168 (+ 188us) client_negotiation.cc:769] Sending connection context
0809 18:49:56.193291 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 18:49:56.193492 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
I20260809 18:49:56.194356 6698 heartbeater.cc:347] Connected to a master server at 127.12.202.254:45899
WARNING: no policy specified for kudu/127.12.202.195@KRBTEST.COM; defaulting to no policy
I20260809 18:49:56.194484 6698 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:56.194715 6698 heartbeater.cc:511] Master 127.12.202.254:45899 requested a full tablet report, sending...
I20260809 18:49:56.195106 6142 ts_manager.cc:194] Registered new tserver with Master: 83ad216d455340bf8a8a3e4332b6d5c6 (127.12.202.194:35769)
I20260809 18:49:56.195497 6142 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:33439
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
I20260809 18:49:56.215245 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:45899
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:49:56.303470 6703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:49:56.303689 6703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:49:56.303711 6703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:49:56.304823 6703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:49:56.304859 6703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:49:56.304885 6703 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:49:56.306262 6703 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:45899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:49:56.306450 6703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:49:56.306633 6703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:49:56.311746 6709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:56.311714 6713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:49:56.311789 6710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:49:56.312043 6703 server_base.cc:1034] running on GCE node
I20260809 18:49:56.312218 6703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:49:56.312505 6703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:49:56.313733 6703 hybrid_clock.cc:648] HybridClock initialized: now 1786301396313721 us; error 29 us; skew 500 ppm
Aug 09 18:49:56 dist-test-slave-45dx krb5kdc[6077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301396, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:49:56.316520 6703 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:49:56.316913 6703 webserver.cc:460] Webserver started at http://127.12.202.195:43661/ using document root <none> and password file <none>
I20260809 18:49:56.317133 6703 fs_manager.cc:359] Metadata directory not provided
I20260809 18:49:56.317178 6703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:49:56.317273 6703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:49:56.318322 6703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "059c0281a1aa4f0b9d519dba0a784eba"
format_stamp: "Formatted at 2026-08-09 18:49:56 on dist-test-slave-45dx"
server_key: "7aefb78c366b4705bd8f38dea16414a1"
server_key_iv: "f63293b9e314d2234f01775763f9e81e"
server_key_version: "encryptionkey@0"
I20260809 18:49:56.318635 6703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "059c0281a1aa4f0b9d519dba0a784eba"
format_stamp: "Formatted at 2026-08-09 18:49:56 on dist-test-slave-45dx"
server_key: "7aefb78c366b4705bd8f38dea16414a1"
server_key_iv: "f63293b9e314d2234f01775763f9e81e"
server_key_version: "encryptionkey@0"
I20260809 18:49:56.319984 6703 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 18:49:56.320860 6725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:56.321087 6703 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:49:56.321187 6703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "059c0281a1aa4f0b9d519dba0a784eba"
format_stamp: "Formatted at 2026-08-09 18:49:56 on dist-test-slave-45dx"
server_key: "7aefb78c366b4705bd8f38dea16414a1"
server_key_iv: "f63293b9e314d2234f01775763f9e81e"
server_key_version: "encryptionkey@0"
I20260809 18:49:56.321262 6703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:49:56.376916 6703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:49:56.379287 6703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:49:56.379506 6703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:49:56.379777 6703 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:49:56.380103 6703 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:49:56.380159 6703 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:56.380193 6703 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:49:56.380221 6703 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:49:56.386713 6703 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:43405
I20260809 18:49:56.386755 6910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:43405 every 8 connection(s)
I20260809 18:49:56.387100 6703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:49:56.391181 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 6703
I20260809 18:49:56.391260 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:49:56.391489 13099 external_mini_cluster.cc:1428] Setting key 50c59da61c416d2f97a512f48b4e3e8b
Aug 09 18:49:56 dist-test-slave-45dx krb5kdc[6077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301396, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:49:56.396943 6205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.387888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:41431 (local address 127.12.202.254:45899)
0809 18:49:56.387968 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:56.387971 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:56.388189 (+ 218us) server_negotiation.cc:407] Connection header received
0809 18:49:56.388792 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:56.388794 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:56.388806 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:56.388871 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:56.389937 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.390450 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.391493 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.391731 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.391814 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:56.394131 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:56.394133 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:56.394133 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:56.394140 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:56.395429 (+ 1289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:56.395846 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:56.395848 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:56.395848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:56.395912 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:56.396170 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:56.396171 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:56.396172 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:56.396351 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:56.396412 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:56.396738 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 18:49:56.396844 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 18:49:56.397163 6913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.387848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:41431)
0809 18:49:56.388059 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:56.388108 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:56.388689 (+ 581us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:56.388930 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:56.388934 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:56.389609 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:49:56.389820 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:56.389825 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.390537 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.390538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:56.391412 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:56.391415 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.391839 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.391841 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:56.392004 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:56.392644 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:49:56.392652 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:49:56.394035 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:49:56.395518 (+ 1483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:56.395527 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:56.395529 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:56.395758 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:56.395987 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:49:56.395988 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:49:56.395988 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:49:56.396102 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:49:56.396450 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:49:56.396457 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:49:56.396599 (+ 142us) client_negotiation.cc:769] Sending connection context
0809 18:49:56.396714 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 18:49:56.396908 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":96,"threads_started":1}
I20260809 18:49:56.397661 6911 heartbeater.cc:347] Connected to a master server at 127.12.202.254:45899
I20260809 18:49:56.397782 6911 heartbeater.cc:464] Registering TS with master...
I20260809 18:49:56.397995 6911 heartbeater.cc:511] Master 127.12.202.254:45899 requested a full tablet report, sending...
I20260809 18:49:56.398401 6142 ts_manager.cc:194] Registered new tserver with Master: 059c0281a1aa4f0b9d519dba0a784eba (127.12.202.195:43405)
I20260809 18:49:56.398793 6142 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:41431
I20260809 18:49:56.403419 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:49:56.411055 6205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.404825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49466 (local address 127.12.202.254:45899)
0809 18:49:56.404926 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:56.404928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:56.405007 (+ 79us) server_negotiation.cc:407] Connection header received
0809 18:49:56.405080 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:56.405081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:56.405091 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:56.405166 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:49:56.405799 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.406291 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.407043 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.407237 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.407311 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:56.408625 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:49:56.408626 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:49:56.408626 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:49:56.408634 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:49:56.409855 (+ 1221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:56.410211 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:56.410212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:56.410213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:56.410276 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:49:56.410482 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:49:56.410483 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:49:56.410483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:49:56.410640 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:49:56.410756 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:56.410858 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 18:49:56.410944 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 18:49:56.412627 6142 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49466:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:49:56.414539 6142 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:49:56.421432 6929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.417211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:38733 (local address 127.0.0.1:47122)
0809 18:49:56.417346 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:56.417357 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:56.417399 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:56.417889 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:56.417890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:56.417892 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:56.417936 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:56.417937 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.419277 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.419278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:56.420194 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:56.420197 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.421093 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.421095 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:56.421191 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:56.421209 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 18:49:56.421282 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 18:49:56.421341 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":4,"thread_start_us":98,"threads_started":1}
I20260809 18:49:56.421552 6932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.417371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44884 (local address 127.12.202.195:43405)
0809 18:49:56.417557 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:56.417561 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:56.417594 (+ 33us) server_negotiation.cc:407] Connection header received
0809 18:49:56.417638 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:56.417640 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:56.417657 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:56.417964 (+ 307us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:56.418027 (+ 63us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.419142 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.420593 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.421172 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.421271 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:56.421331 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:56.421409 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 18:49:56.421455 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":96,"threads_started":1}
I20260809 18:49:56.421548 6927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.417002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:43405 (local address 127.0.0.1:44884)
0809 18:49:56.417110 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:56.417153 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:56.417214 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:56.417780 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:56.417783 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:56.417786 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:56.417884 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:56.417886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.419272 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.419273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:56.420494 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:56.420496 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.421270 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.421271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:56.421338 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:56.421343 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:49:56.421396 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 18:49:56.421439 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82,"mutex_wait_us":30,"thread_start_us":61,"threads_started":1}
I20260809 18:49:56.421880 6928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.417080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:35769 (local address 127.0.0.1:40530)
0809 18:49:56.417248 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:56.417259 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:56.417315 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:56.418027 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:56.418028 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:56.418030 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:56.418066 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:56.418067 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.419049 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.419050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:56.420467 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:56.420471 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.421434 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.421435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:56.421589 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:56.421593 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:49:56.421778 (+ 185us) client_negotiation.cc:240] Negotiation successful
0809 18:49:56.421821 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":111,"threads_started":1}
I20260809 18:49:56.421942 6934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.417585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40530 (local address 127.12.202.194:35769)
0809 18:49:56.417786 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:56.417791 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:56.417801 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:49:56.417842 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:56.417845 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:56.417861 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:56.417941 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:56.418152 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.418825 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.420569 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.421283 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.421351 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:56.421402 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:56.421813 (+ 411us) server_negotiation.cc:299] Negotiation successful
0809 18:49:56.421858 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":84,"threads_started":1}
I20260809 18:49:56.422276 6933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.417472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47122 (local address 127.12.202.193:38733)
0809 18:49:56.417723 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:56.417728 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:56.417738 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:49:56.417774 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:56.417776 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:56.417790 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:56.418026 (+ 236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:56.418107 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.419149 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.420293 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.420993 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.421071 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:56.421124 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:56.422131 (+ 1007us) server_negotiation.cc:299] Negotiation successful
0809 18:49:56.422189 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":102,"threads_started":1}
I20260809 18:49:56.422426 6800 tablet_service.cc:1467] Processing CreateTablet for tablet eed25314989d424f9f3b7717f4f7c339 (DEFAULT_TABLE table=test-table [id=ff5dfb7cf3cd4ac792a72b3f1192c431]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:49:56.422688 6584 tablet_service.cc:1467] Processing CreateTablet for tablet eed25314989d424f9f3b7717f4f7c339 (DEFAULT_TABLE table=test-table [id=ff5dfb7cf3cd4ac792a72b3f1192c431]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:49:56.422811 6800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed25314989d424f9f3b7717f4f7c339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:56.423005 6584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed25314989d424f9f3b7717f4f7c339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:56.422989 6355 tablet_service.cc:1467] Processing CreateTablet for tablet eed25314989d424f9f3b7717f4f7c339 (DEFAULT_TABLE table=test-table [id=ff5dfb7cf3cd4ac792a72b3f1192c431]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:49:56.423357 6355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed25314989d424f9f3b7717f4f7c339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:49:56.426287 6935 tablet_bootstrap.cc:492] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba: Bootstrap starting.
I20260809 18:49:56.426751 6938 tablet_bootstrap.cc:492] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Bootstrap starting.
I20260809 18:49:56.427175 6935 tablet_bootstrap.cc:654] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:56.427524 6938 tablet_bootstrap.cc:654] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:56.427973 6935 log.cc:824] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:56.428217 6938 log.cc:824] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:56.428437 6937 tablet_bootstrap.cc:492] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6: Bootstrap starting.
I20260809 18:49:56.428964 6935 tablet_bootstrap.cc:492] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba: No bootstrap required, opened a new log
I20260809 18:49:56.429049 6935 ts_tablet_manager.cc:1397] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:49:56.429121 6938 tablet_bootstrap.cc:492] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891: No bootstrap required, opened a new log
I20260809 18:49:56.429199 6938 ts_tablet_manager.cc:1397] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 18:49:56.429207 6937 tablet_bootstrap.cc:654] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6: Neither blocks nor log segments found. Creating new log.
I20260809 18:49:56.429840 6937 log.cc:824] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6: Log is configured to *not* fsync() on all Append() calls
I20260809 18:49:56.430670 6937 tablet_bootstrap.cc:492] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6: No bootstrap required, opened a new log
I20260809 18:49:56.430758 6937 ts_tablet_manager.cc:1397] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:49:56.430933 6938 raft_consensus.cc:348] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:49:56.431100 6938 raft_consensus.cc:374] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:56.431143 6938 raft_consensus.cc:729] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97b8b1f4e4234a799bfe7e1d6c3d0891, State: Initialized, Role: FOLLOWER
I20260809 18:49:56.431257 6938 consensus_queue.cc:260] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:49:56.431335 6935 raft_consensus.cc:348] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:49:56.431519 6935 raft_consensus.cc:374] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:56.431556 6938 ts_tablet_manager.cc:1428] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 18:49:56.431565 6935 raft_consensus.cc:729] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 059c0281a1aa4f0b9d519dba0a784eba, State: Initialized, Role: FOLLOWER
I20260809 18:49:56.431663 6472 heartbeater.cc:503] Master 127.12.202.254:45899 was elected leader, sending a full tablet report...
I20260809 18:49:56.431692 6935 consensus_queue.cc:260] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:49:56.432014 6935 ts_tablet_manager.cc:1428] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:49:56.432046 6911 heartbeater.cc:503] Master 127.12.202.254:45899 was elected leader, sending a full tablet report...
I20260809 18:49:56.433568 6937 raft_consensus.cc:348] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:49:56.433723 6937 raft_consensus.cc:374] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:49:56.433784 6937 raft_consensus.cc:729] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83ad216d455340bf8a8a3e4332b6d5c6, State: Initialized, Role: FOLLOWER
I20260809 18:49:56.433902 6937 consensus_queue.cc:260] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:49:56.434212 6937 ts_tablet_manager.cc:1428] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:49:56.434249 6698 heartbeater.cc:503] Master 127.12.202.254:45899 was elected leader, sending a full tablet report...
W20260809 18:49:56.513751 6474 tablet.cc:2369] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:49:56.637741 6912 tablet.cc:2369] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:49:56.649084 6949 raft_consensus.cc:482] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:49:56.649211 6949 raft_consensus.cc:504] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:49:56.649528 6949 leader_election.cc:288] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 059c0281a1aa4f0b9d519dba0a784eba (127.12.202.195:43405), 83ad216d455340bf8a8a3e4332b6d5c6 (127.12.202.194:35769)
I20260809 18:49:56.652695 6934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.649842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:40905 (local address 127.12.202.194:35769)
0809 18:49:56.649902 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:56.649904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:56.649996 (+ 92us) server_negotiation.cc:407] Connection header received
0809 18:49:56.650078 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:56.650079 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:56.650090 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:56.650164 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:56.650367 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.650828 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.651873 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.652272 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.652404 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:56.652414 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:56.652578 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 18:49:56.652622 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 18:49:56.652693 6932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.649893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:56423 (local address 127.12.202.195:43405)
0809 18:49:56.649956 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:56.649958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:56.649968 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:49:56.650040 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:56.650041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:56.650051 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:56.650123 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:49:56.650311 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.650782 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.651871 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.652278 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.652412 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:56.652422 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:56.652577 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 18:49:56.652616 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 18:49:56.652714 6956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.649749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:43405 (local address 127.12.202.193:56423)
0809 18:49:56.649899 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:56.649912 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:56.649970 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:56.650130 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:56.650131 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:56.650133 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:56.650218 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:56.650220 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.650889 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.650891 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:56.651752 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:56.651754 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.652417 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.652418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:56.652496 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:56.652500 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:49:56.652571 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 18:49:56.652623 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":28,"thread_start_us":71,"threads_started":1}
I20260809 18:49:56.652745 6955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.649749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:35769 (local address 127.12.202.193:40905)
0809 18:49:56.649925 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:56.649938 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:49:56.650009 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:49:56.650167 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:49:56.650167 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:49:56.650169 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:49:56.650286 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:56.650288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.650919 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.650920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:56.651754 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:49:56.651757 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.652408 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.652409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:49:56.652498 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:56.652502 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:49:56.652572 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 18:49:56.652622 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":39,"thread_start_us":66,"threads_started":1}
I20260809 18:49:56.653172 6835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed25314989d424f9f3b7717f4f7c339" candidate_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "059c0281a1aa4f0b9d519dba0a784eba" is_pre_election: true
I20260809 18:49:56.653216 6614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed25314989d424f9f3b7717f4f7c339" candidate_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" is_pre_election: true
I20260809 18:49:56.653352 6614 raft_consensus.cc:2454] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97b8b1f4e4234a799bfe7e1d6c3d0891 in term 0.
I20260809 18:49:56.653353 6835 raft_consensus.cc:2454] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97b8b1f4e4234a799bfe7e1d6c3d0891 in term 0.
I20260809 18:49:56.653596 6273 leader_election.cc:302] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83ad216d455340bf8a8a3e4332b6d5c6, 97b8b1f4e4234a799bfe7e1d6c3d0891; no voters:
I20260809 18:49:56.653760 6949 raft_consensus.cc:2781] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:49:56.653822 6949 raft_consensus.cc:482] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:49:56.653861 6949 raft_consensus.cc:3037] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:56.654623 6949 raft_consensus.cc:504] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:49:56.654780 6949 leader_election.cc:288] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 1 election: Requested vote from peers 059c0281a1aa4f0b9d519dba0a784eba (127.12.202.195:43405), 83ad216d455340bf8a8a3e4332b6d5c6 (127.12.202.194:35769)
I20260809 18:49:56.654933 6835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed25314989d424f9f3b7717f4f7c339" candidate_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "059c0281a1aa4f0b9d519dba0a784eba"
I20260809 18:49:56.654968 6614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed25314989d424f9f3b7717f4f7c339" candidate_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83ad216d455340bf8a8a3e4332b6d5c6"
I20260809 18:49:56.655009 6835 raft_consensus.cc:3037] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:56.655074 6614 raft_consensus.cc:3037] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:49:56.655812 6835 raft_consensus.cc:2454] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97b8b1f4e4234a799bfe7e1d6c3d0891 in term 1.
I20260809 18:49:56.655819 6614 raft_consensus.cc:2454] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97b8b1f4e4234a799bfe7e1d6c3d0891 in term 1.
I20260809 18:49:56.656002 6273 leader_election.cc:302] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83ad216d455340bf8a8a3e4332b6d5c6, 97b8b1f4e4234a799bfe7e1d6c3d0891; no voters:
I20260809 18:49:56.656137 6949 raft_consensus.cc:2781] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:49:56.656364 6949 raft_consensus.cc:686] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 LEADER]: Becoming Leader. State: Replica: 97b8b1f4e4234a799bfe7e1d6c3d0891, State: Running, Role: LEADER
I20260809 18:49:56.656486 6949 consensus_queue.cc:237] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:49:56.657354 6142 catalog_manager.cc:5495] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 reported cstate change: term changed from 0 to 1, leader changed from <none> to 97b8b1f4e4234a799bfe7e1d6c3d0891 (127.12.202.193). New cstate: current_term: 1 leader_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } health_report { overall_health: HEALTHY } } }
W20260809 18:49:56.682327 6699 tablet.cc:2369] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:49:56.707340 6933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.704837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47124 (local address 127.12.202.193:38733)
0809 18:49:56.704927 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0809 18:49:56.704929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:49:56.704937 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:49:56.704987 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:49:56.704988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:49:56.705010 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:49:56.705087 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:49:56.705265 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.705744 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.706532 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:49:56.706750 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:49:56.706829 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:49:56.706971 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:49:56.707091 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:49:56.707185 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 18:49:56.707226 (+ 41us) server_negotiation.cc:299] Negotiation successful
0809 18:49:56.707246 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 18:49:56.709318 6614 raft_consensus.cc:1261] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6 [term 1 FOLLOWER]: Refusing update from remote peer 97b8b1f4e4234a799bfe7e1d6c3d0891: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:49:56.709321 6835 raft_consensus.cc:1261] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba [term 1 FOLLOWER]: Refusing update from remote peer 97b8b1f4e4234a799bfe7e1d6c3d0891: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:49:56.709749 6958 consensus_queue.cc:1035] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [LEADER]: Connected to new peer: Peer: permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:49:56.709909 6949 consensus_queue.cc:1035] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:49:56.711972 6962 mvcc.cc:205] Tried to move back new op lower bound from 7316690520918396928 to 7316690520705482752. Current Snapshot: MvccSnapshot[applied={T|T < 7316690520918396928}]
I20260809 18:49:56.715294 6142 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49466:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:49:56.715409 6142 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49466:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:49:56.716288 6142 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: Sending DeleteTablet for 3 replicas of tablet eed25314989d424f9f3b7717f4f7c339
I20260809 18:49:56.716751 6584 tablet_service.cc:1514] Processing DeleteTablet for tablet eed25314989d424f9f3b7717f4f7c339 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:49:56 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:40530
I20260809 18:49:56.716759 6355 tablet_service.cc:1514] Processing DeleteTablet for tablet eed25314989d424f9f3b7717f4f7c339 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:49:56 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:47122
I20260809 18:49:56.717020 6979 tablet_replica.cc:330] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6: stopping tablet replica
I20260809 18:49:56.717021 6800 tablet_service.cc:1514] Processing DeleteTablet for tablet eed25314989d424f9f3b7717f4f7c339 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:49:56 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:44884
I20260809 18:49:56.717191 6979 raft_consensus.cc:2229] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:49:56.717248 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 6241
I20260809 18:49:56.717258 6984 tablet_replica.cc:330] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba: stopping tablet replica
I20260809 18:49:56.717360 6984 raft_consensus.cc:2229] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:49:56.717453 6984 raft_consensus.cc:2258] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:49:56.725108 6984 ts_tablet_manager.cc:1905] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:49:56.727159 6984 ts_tablet_manager.cc:1918] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:49:56.727340 6984 log.cc:1196] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/eed25314989d424f9f3b7717f4f7c339
I20260809 18:49:56.727804 6984 ts_tablet_manager.cc:1939] T eed25314989d424f9f3b7717f4f7c339 P 059c0281a1aa4f0b9d519dba0a784eba: Deleting consensus metadata
I20260809 18:49:56.729048 6123 catalog_manager.cc:4841] TS 059c0281a1aa4f0b9d519dba0a784eba (127.12.202.195:43405): tablet eed25314989d424f9f3b7717f4f7c339 (table test-table [id=ff5dfb7cf3cd4ac792a72b3f1192c431]) successfully deleted
I20260809 18:49:56.736039 6979 raft_consensus.cc:2258] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:49:56.736593 6979 ts_tablet_manager.cc:1905] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:49:56.738130 6979 ts_tablet_manager.cc:1918] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:49:56.738226 6979 log.cc:1196] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/eed25314989d424f9f3b7717f4f7c339
I20260809 18:49:56.738466 6979 ts_tablet_manager.cc:1939] T eed25314989d424f9f3b7717f4f7c339 P 83ad216d455340bf8a8a3e4332b6d5c6: Deleting consensus metadata
I20260809 18:49:56.739040 6125 catalog_manager.cc:4841] TS 83ad216d455340bf8a8a3e4332b6d5c6 (127.12.202.194:35769): tablet eed25314989d424f9f3b7717f4f7c339 (table test-table [id=ff5dfb7cf3cd4ac792a72b3f1192c431]) successfully deleted
W20260809 18:49:56.740935 6123 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.202.193:38733 (error 108)
I20260809 18:49:56.741254 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 6480
I20260809 18:49:56.742923 6928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:49:56.741376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:38733 (local address 127.0.0.1:47138)
0809 18:49:56.742837 (+ 1461us) negotiation.cc:107] Waiting for socket to connect
0809 18:49:56.742890 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:38733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1441}
W20260809 18:49:56.743115 6123 catalog_manager.cc:4584] TS 97b8b1f4e4234a799bfe7e1d6c3d0891 (127.12.202.193:38733): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet eed25314989d424f9f3b7717f4f7c339: Network error: Client connection negotiation failed: client connection to 127.12.202.193:38733: connect: Connection refused (error 111)
I20260809 18:49:56.760296 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 6703
I20260809 18:49:56.768432 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 6092
I20260809 18:50:16.778122 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:45899
--webserver_interface=127.12.202.254
--webserver_port=41603
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:45899
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:50:16.863564 6986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:16.863786 6986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:16.863811 6986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:16.865099 6986 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 18:50:16.865146 6986 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 18:50:16.865159 6986 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 18:50:16.865171 6986 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:50:16.865185 6986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:16.865197 6986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:16.865209 6986 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:50:16.865221 6986 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:50:16.866699 6986 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:45899
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:45899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=41603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:16.866911 6986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:16.867093 6986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:16.876861 7000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:16.876888 6998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:16.876900 6986 server_base.cc:1034] running on GCE node
W20260809 18:50:16.876926 6995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:16.877373 6986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:16.877715 6986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:16.878886 6986 hybrid_clock.cc:648] HybridClock initialized: now 1786301416878872 us; error 46 us; skew 500 ppm
Aug 09 18:50:16 dist-test-slave-45dx krb5kdc[6077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301416, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:50:16.885200 6986 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:50:16.885721 6986 webserver.cc:460] Webserver started at http://127.12.202.254:41603/ using document root <none> and password file <none>
I20260809 18:50:16.885936 6986 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:16.885989 6986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:16.887399 6986 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:50:16.888091 7012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:16.888290 6986 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:50:16.888406 6986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "57c394e9c5594afc8ca1a25b6d893f8c"
format_stamp: "Formatted at 2026-08-09 18:49:55 on dist-test-slave-45dx"
server_key: "d618c76319f1760af3bd16f4df22a607"
server_key_iv: "2c94c32ea58224c35cc926e42983a9a0"
server_key_version: "encryptionkey@0"
I20260809 18:50:16.888799 6986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:16.909787 6986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:16.911659 6986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:16.911772 6986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:16.916370 6986 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:45899
I20260809 18:50:16.916432 7099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:45899 every 8 connection(s)
I20260809 18:50:16.916818 6986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:50:16.918332 7100 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:50:16.919077 7100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: Bootstrap starting.
I20260809 18:50:16.925034 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 6986
I20260809 18:50:16.925400 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:38733
--local_ip_for_outbound_sockets=127.12.202.193
--tserver_master_addrs=127.12.202.254:45899
--webserver_port=32993
--webserver_interface=127.12.202.193
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:50:16.929203 7100 log.cc:824] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:16.931210 7100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:50:16.931536 7100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: Bootstrap complete.
I20260809 18:50:16.933939 7100 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45899 } }
I20260809 18:50:16.934165 7100 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57c394e9c5594afc8ca1a25b6d893f8c, State: Initialized, Role: FOLLOWER
I20260809 18:50:16.934340 7100 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45899 } }
I20260809 18:50:16.934402 7100 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:50:16.934468 7100 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:50:16.934521 7100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 1 FOLLOWER]: Advancing to term 2
I20260809 18:50:16.935555 7100 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45899 } }
I20260809 18:50:16.935642 7100 leader_election.cc:302] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57c394e9c5594afc8ca1a25b6d893f8c; no voters:
I20260809 18:50:16.935856 7100 leader_election.cc:288] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 18:50:16.935896 7107 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 2 FOLLOWER]: Leader election won for term 2
I20260809 18:50:16.936021 7107 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 2 LEADER]: Becoming Leader. State: Replica: 57c394e9c5594afc8ca1a25b6d893f8c, State: Running, Role: LEADER
I20260809 18:50:16.936149 7100 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:50:16.936218 7107 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45899 } }
I20260809 18:50:16.936620 7110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45899 } } }
I20260809 18:50:16.936793 7110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [sys.catalog]: This master's current role is: LEADER
I20260809 18:50:16.936618 7107 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57c394e9c5594afc8ca1a25b6d893f8c. Latest consensus state: current_term: 2 leader_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45899 } } }
I20260809 18:50:16.937014 7107 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [sys.catalog]: This master's current role is: LEADER
I20260809 18:50:16.937538 7121 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:50:16.938355 7121 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:50:16.938515 7121 catalog_manager.cc:1259] Loaded cluster ID: 767891e48a3d4e6c9a09ccf4b7ccaca2
I20260809 18:50:16.938568 7121 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:50:16.939349 7121 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:50:16.939482 7121 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: Loaded TSK: 0
I20260809 18:50:16.945688 7121 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: Generated new TSK 1
I20260809 18:50:16.945803 7121 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 18:50:17.025236 7102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:17.025460 7102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:17.025502 7102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:17.026664 7102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:17.026731 7102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:17.026777 7102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:50:17.028249 7102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:38733
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=32993
--tserver_master_addrs=127.12.202.254:45899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:17.028538 7102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:17.028759 7102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:17.034789 7149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:17.034894 7102 server_base.cc:1034] running on GCE node
W20260809 18:50:17.034904 7151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:17.034803 7143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:17.035230 7102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:17.035507 7102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:17.036713 7102 hybrid_clock.cc:648] HybridClock initialized: now 1786301417036700 us; error 27 us; skew 500 ppm
Aug 09 18:50:17 dist-test-slave-45dx krb5kdc[6077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301417, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:50:17.039453 7102 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:50:17.039991 7102 webserver.cc:460] Webserver started at http://127.12.202.193:32993/ using document root <none> and password file <none>
I20260809 18:50:17.040251 7102 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:17.040362 7102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:17.041800 7102 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:50:17.042506 7165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:17.042760 7102 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:50:17.042871 7102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891"
format_stamp: "Formatted at 2026-08-09 18:49:55 on dist-test-slave-45dx"
server_key: "cf5269c2e3aa98b356b45b3721a2e1ee"
server_key_iv: "694b0f11f14e19ac0c777721ac99a86f"
server_key_version: "encryptionkey@0"
I20260809 18:50:17.043300 7102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:17.058310 7102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:17.060844 7102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:17.061012 7102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:17.061286 7102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:50:17.061810 7180 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 18:50:17.063303 7102 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 18:50:17.063364 7102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 18:50:17.063398 7102 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 18:50:17.064236 7102 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 18:50:17.064282 7102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 18:50:17.064391 7180 tablet_bootstrap.cc:492] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Bootstrap starting.
I20260809 18:50:17.071471 7102 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:38733
I20260809 18:50:17.071678 7361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:38733 every 8 connection(s)
I20260809 18:50:17.071988 7102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:50:17.075368 7180 log.cc:824] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:17.078630 7180 tablet_bootstrap.cc:492] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:50:17.078943 7180 tablet_bootstrap.cc:492] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Bootstrap complete.
I20260809 18:50:17.080082 7180 ts_tablet_manager.cc:1397] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.006s
Aug 09 18:50:17 dist-test-slave-45dx krb5kdc[6077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301417, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:50:17.081444 7180 raft_consensus.cc:348] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:50:17.081774 7180 raft_consensus.cc:729] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97b8b1f4e4234a799bfe7e1d6c3d0891, State: Initialized, Role: FOLLOWER
I20260809 18:50:17.081961 7180 consensus_queue.cc:260] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:50:17.082304 7180 ts_tablet_manager.cc:1428] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Time spent starting tablet: real 0.002s user 0.006s sys 0.000s
I20260809 18:50:17.082353 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 7102
I20260809 18:50:17.082862 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:35769
--local_ip_for_outbound_sockets=127.12.202.194
--tserver_master_addrs=127.12.202.254:45899
--webserver_port=46289
--webserver_interface=127.12.202.194
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:50:17.085510 7364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.072730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:44673)
0809 18:50:17.073040 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:17.073250 (+ 210us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:17.073819 (+ 569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:17.074428 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:17.074432 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:17.074777 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:50:17.075047 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:17.075053 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.076788 (+ 1735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.076789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:17.077992 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:17.077994 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.078878 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.078879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:17.079023 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.079647 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:50:17.079656 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:50:17.081410 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:50:17.083626 (+ 2216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:17.083633 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:17.083635 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:17.083923 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:17.084202 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:17.084203 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:17.084203 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:17.084352 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:17.084912 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:50:17.084919 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:50:17.085062 (+ 143us) client_negotiation.cc:769] Sending connection context
0809 18:50:17.085165 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 18:50:17.085324 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":119,"threads_started":1}
I20260809 18:50:17.085639 7369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.072818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:44673 (local address 127.12.202.254:45899)
0809 18:50:17.073175 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:17.073184 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:17.073989 (+ 805us) server_negotiation.cc:407] Connection header received
0809 18:50:17.074119 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:17.074124 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:17.074177 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:17.074294 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:17.075184 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.076649 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.078095 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.078663 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.078761 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.081537 (+ 2776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:17.081541 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:17.081542 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:50:17.081554 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:17.083532 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:17.084015 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:17.084018 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:17.084018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:17.084131 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:17.084439 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:17.084440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:17.084441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:17.084769 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:17.084852 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:17.085267 (+ 415us) server_negotiation.cc:299] Negotiation successful
0809 18:50:17.085436 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":101,"threads_started":1}
I20260809 18:50:17.086369 7362 heartbeater.cc:347] Connected to a master server at 127.12.202.254:45899
I20260809 18:50:17.086474 7362 heartbeater.cc:464] Registering TS with master...
I20260809 18:50:17.086649 7362 heartbeater.cc:511] Master 127.12.202.254:45899 requested a full tablet report, sending...
I20260809 18:50:17.087493 7048 ts_manager.cc:194] Registered new tserver with Master: 97b8b1f4e4234a799bfe7e1d6c3d0891 (127.12.202.193:38733)
I20260809 18:50:17.088740 7048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:44673
I20260809 18:50:17.089780 7362 heartbeater.cc:503] Master 127.12.202.254:45899 was elected leader, sending a full tablet report...
Aug 09 18:50:17 dist-test-slave-45dx krb5kdc[6077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301416, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for kudu/127.12.202.193@KRBTEST.COM
I20260809 18:50:17.098008 7374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.088217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:38733 (local address 127.0.0.1:33598)
0809 18:50:17.089055 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:17.089086 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:17.089150 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:17.089438 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:17.089442 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:17.089734 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:50:17.089783 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:17.089785 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.091155 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.091156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:17.092053 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:17.092055 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.092692 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.092693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:17.092760 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.093278 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:50:17.093282 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:50:17.094826 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:50:17.096877 (+ 2051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:17.096884 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:17.096886 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:17.097113 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:17.097319 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:17.097319 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:17.097320 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:17.097375 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:17.097671 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:50:17.097677 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:50:17.097724 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 18:50:17.097793 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 18:50:17.097913 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":811,"thread_start_us":319,"threads_started":1}
I20260809 18:50:17.098425 7375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.088420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33598 (local address 127.12.202.193:38733)
0809 18:50:17.089269 (+ 849us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:17.089272 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:17.089281 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:50:17.089310 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:17.089311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:17.089325 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:17.089384 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:17.089875 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.091067 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.092135 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.092589 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.092643 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.094936 (+ 2293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:17.094945 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:17.094945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:50:17.094954 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:17.096776 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:17.097197 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:17.097200 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:17.097200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:17.097257 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:17.097433 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:17.097434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:17.097434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:17.097581 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:17.097646 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:17.098226 (+ 580us) server_negotiation.cc:299] Negotiation successful
0809 18:50:17.098334 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":818,"thread_start_us":79,"threads_started":1}
I20260809 18:50:17.098709 7255 tablet_service.cc:1514] Processing DeleteTablet for tablet eed25314989d424f9f3b7717f4f7c339 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:49:56 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:33598
I20260809 18:50:17.099356 7376 tablet_replica.cc:330] stopping tablet replica
I20260809 18:50:17.099462 7376 raft_consensus.cc:2229] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:50:17.099525 7376 raft_consensus.cc:2258] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:50:17.099812 7376 ts_tablet_manager.cc:1905] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:50:17.102517 7376 ts_tablet_manager.cc:1918] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:50:17.102596 7376 log.cc:1196] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/wal/wals/eed25314989d424f9f3b7717f4f7c339
I20260809 18:50:17.102820 7376 ts_tablet_manager.cc:1939] T eed25314989d424f9f3b7717f4f7c339 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Deleting consensus metadata
I20260809 18:50:17.103354 7017 catalog_manager.cc:4841] TS 97b8b1f4e4234a799bfe7e1d6c3d0891 (127.12.202.193:38733): tablet eed25314989d424f9f3b7717f4f7c339 (table test-table [id=ff5dfb7cf3cd4ac792a72b3f1192c431]) successfully deleted
W20260809 18:50:17.171518 7373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:17.171718 7373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:17.171741 7373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:17.172878 7373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:17.172919 7373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:17.172945 7373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:50:17.174319 7373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:35769
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=46289
--tserver_master_addrs=127.12.202.254:45899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:17.174510 7373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:17.174678 7373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:17.179865 7381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:17.179877 7383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:17.180126 7373 server_base.cc:1034] running on GCE node
W20260809 18:50:17.179877 7386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:17.180413 7373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:17.180716 7373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:17.181890 7373 hybrid_clock.cc:648] HybridClock initialized: now 1786301417181871 us; error 38 us; skew 500 ppm
Aug 09 18:50:17 dist-test-slave-45dx krb5kdc[6077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301417, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:50:17.184458 7373 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:50:17.184904 7373 webserver.cc:460] Webserver started at http://127.12.202.194:46289/ using document root <none> and password file <none>
I20260809 18:50:17.185174 7373 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:17.185258 7373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:17.186555 7373 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:50:17.187136 7396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:17.187305 7373 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:50:17.187412 7373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "83ad216d455340bf8a8a3e4332b6d5c6"
format_stamp: "Formatted at 2026-08-09 18:49:56 on dist-test-slave-45dx"
server_key: "634412cb2ea8dc871305d95e88b457f5"
server_key_iv: "69b1cb2d47ff8ca60498d46bf6bea99d"
server_key_version: "encryptionkey@0"
I20260809 18:50:17.187748 7373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:17.206555 7373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:17.208544 7373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:17.208702 7373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:17.208941 7373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:50:17.209244 7373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:50:17.209298 7373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:17.209347 7373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:50:17.209371 7373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:17.215217 7373 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:35769
I20260809 18:50:17.215272 7597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:35769 every 8 connection(s)
I20260809 18:50:17.215602 7373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:50:17.219800 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 7373
I20260809 18:50:17.220129 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:43405
--local_ip_for_outbound_sockets=127.12.202.195
--tserver_master_addrs=127.12.202.254:45899
--webserver_port=43661
--webserver_interface=127.12.202.195
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 18:50:17 dist-test-slave-45dx krb5kdc[6077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301417, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:50:17.225281 7602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.216367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:35993)
0809 18:50:17.216526 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:17.216562 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:17.217022 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:17.217249 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:17.217252 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:17.217831 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:50:17.218013 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:17.218018 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.218652 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.218653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:17.219410 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:17.219412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.219843 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.219844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:17.220008 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.220572 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:50:17.220580 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:50:17.222204 (+ 1624us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:50:17.223933 (+ 1729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:17.223939 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:17.223941 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:17.224138 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:17.224373 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:17.224374 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:17.224374 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:17.224471 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:17.224770 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:50:17.224774 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:50:17.224943 (+ 169us) client_negotiation.cc:769] Sending connection context
0809 18:50:17.225024 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 18:50:17.225134 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":82,"threads_started":1}
I20260809 18:50:17.225306 7369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.216384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:35993 (local address 127.12.202.254:45899)
0809 18:50:17.216441 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:17.216443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:17.216648 (+ 205us) server_negotiation.cc:407] Connection header received
0809 18:50:17.217103 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:17.217104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:17.217117 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:17.217170 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:17.218089 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.218564 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.219482 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.219756 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.219830 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.222296 (+ 2466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:17.222298 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:17.222298 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:50:17.222307 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:17.223853 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:17.224209 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:17.224211 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:17.224211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:17.224274 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:17.224545 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:17.224546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:17.224546 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:17.224704 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:17.224778 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:17.225075 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 18:50:17.225176 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 18:50:17.225797 7598 heartbeater.cc:347] Connected to a master server at 127.12.202.254:45899
I20260809 18:50:17.225914 7598 heartbeater.cc:464] Registering TS with master...
I20260809 18:50:17.226125 7598 heartbeater.cc:511] Master 127.12.202.254:45899 requested a full tablet report, sending...
I20260809 18:50:17.226575 7048 ts_manager.cc:194] Registered new tserver with Master: 83ad216d455340bf8a8a3e4332b6d5c6 (127.12.202.194:35769)
I20260809 18:50:17.226948 7048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:35993
W20260809 18:50:17.304169 7605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:17.304390 7605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:17.304414 7605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:17.305541 7605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:17.305586 7605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:17.305612 7605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:50:17.307119 7605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:43405
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=43661
--tserver_master_addrs=127.12.202.254:45899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:17.307375 7605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:17.307641 7605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:17.312716 7612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:17.312784 7605 server_base.cc:1034] running on GCE node
W20260809 18:50:17.312732 7611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:17.312723 7614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:17.313134 7605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:17.313374 7605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:17.314510 7605 hybrid_clock.cc:648] HybridClock initialized: now 1786301417314500 us; error 26 us; skew 500 ppm
Aug 09 18:50:17 dist-test-slave-45dx krb5kdc[6077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301417, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:50:17.317184 7605 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:50:17.317625 7605 webserver.cc:460] Webserver started at http://127.12.202.195:43661/ using document root <none> and password file <none>
I20260809 18:50:17.317852 7605 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:17.317936 7605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:17.319262 7605 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:50:17.319867 7626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:17.320029 7605 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:50:17.320138 7605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "059c0281a1aa4f0b9d519dba0a784eba"
format_stamp: "Formatted at 2026-08-09 18:49:56 on dist-test-slave-45dx"
server_key: "7aefb78c366b4705bd8f38dea16414a1"
server_key_iv: "f63293b9e314d2234f01775763f9e81e"
server_key_version: "encryptionkey@0"
I20260809 18:50:17.320529 7605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:17.348984 7605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:17.351481 7605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:17.351655 7605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:17.351930 7605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:50:17.352252 7605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:50:17.352340 7605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:17.352387 7605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:50:17.352408 7605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:17.358711 7605 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:43405
I20260809 18:50:17.358760 7813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:43405 every 8 connection(s)
I20260809 18:50:17.359119 7605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:50:17 dist-test-slave-45dx krb5kdc[6077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301417, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:50:17.366833 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 7605
I20260809 18:50:17.368432 7369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.359820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:39667 (local address 127.12.202.254:45899)
0809 18:50:17.359879 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:17.359881 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:17.360078 (+ 197us) server_negotiation.cc:407] Connection header received
0809 18:50:17.360645 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:17.360646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:17.360656 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:17.360702 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:17.361562 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.362079 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.363090 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.363266 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.363316 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.365495 (+ 2179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:17.365497 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:17.365497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:50:17.365504 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:17.366818 (+ 1314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:17.367387 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:17.367388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:17.367389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:17.367459 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:17.367728 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:17.367729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:17.367730 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:17.367859 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:17.367936 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:17.368217 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 18:50:17.368343 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 18:50:17.368614 7816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.359792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:39667)
0809 18:50:17.359955 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:17.359989 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:17.360556 (+ 567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:17.360764 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:17.360767 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:17.361291 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:50:17.361489 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:17.361494 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.362165 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.362166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:17.363017 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:17.363020 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.363338 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.363338 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:17.363449 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.363881 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:50:17.363889 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:50:17.365381 (+ 1492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:50:17.366922 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:17.366929 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:17.366932 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:17.367303 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:17.367532 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:17.367533 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:17.367533 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:17.367649 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:17.367927 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:50:17.367934 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:50:17.368076 (+ 142us) client_negotiation.cc:769] Sending connection context
0809 18:50:17.368181 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 18:50:17.368379 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":98,"threads_started":1}
I20260809 18:50:17.369091 7814 heartbeater.cc:347] Connected to a master server at 127.12.202.254:45899
I20260809 18:50:17.369201 7814 heartbeater.cc:464] Registering TS with master...
I20260809 18:50:17.369383 7814 heartbeater.cc:511] Master 127.12.202.254:45899 requested a full tablet report, sending...
I20260809 18:50:17.369766 7048 ts_manager.cc:194] Registered new tserver with Master: 059c0281a1aa4f0b9d519dba0a784eba (127.12.202.195:43405)
I20260809 18:50:17.370121 7048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:39667
I20260809 18:50:17.373816 7818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.367324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43386 (local address 127.12.202.254:45899)
0809 18:50:17.367454 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:17.367456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:17.367537 (+ 81us) server_negotiation.cc:407] Connection header received
0809 18:50:17.367612 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:17.367612 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:17.367625 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:17.367708 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:17.368336 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.369075 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.369910 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.370090 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.370162 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.371476 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:17.371477 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:17.371478 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:50:17.371485 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:17.372679 (+ 1194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:17.373032 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:17.373033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:17.373034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:17.373104 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:17.373318 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:17.373319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:17.373319 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:17.373423 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:17.373605 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:17.373640 (+ 35us) server_negotiation.cc:299] Negotiation successful
0809 18:50:17.373718 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":77,"threads_started":1}
I20260809 18:50:17.374544 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:50:17.377048 7818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.374907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43400 (local address 127.12.202.254:45899)
0809 18:50:17.374968 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:17.374970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:17.375059 (+ 89us) server_negotiation.cc:407] Connection header received
0809 18:50:17.375119 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:17.375119 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:17.375165 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:17.375220 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:50:17.375306 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.375727 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.376484 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.376667 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.376723 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.376836 (+ 113us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:50:17.376873 (+ 37us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 18:50:17.376983 (+ 110us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43400: token expired
Metrics: {"server-negotiator.queue_time_us":38}
W20260809 18:50:17.377101 7818 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43400: token expired
W20260809 18:50:17.382110 6917 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.12.202.254:45899)
I20260809 18:50:17.387885 7818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.382400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43404 (local address 127.12.202.254:45899)
0809 18:50:17.382457 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:17.382459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:17.382467 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:50:17.382489 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:17.382490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:17.382499 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:17.382553 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:17.383052 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.383513 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.384177 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.384435 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.384516 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.385575 (+ 1059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:17.385576 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:17.385576 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:50:17.385583 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:17.386797 (+ 1214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:17.387132 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:17.387134 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:17.387134 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:17.387190 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:17.387417 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:17.387418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:17.387418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:17.387528 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:17.387632 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:17.387720 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 18:50:17.387796 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 18:50:17.389071 7048 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43404:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:50:17.390664 7048 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:50:17.393172 7255 tablet_service.cc:1467] Processing CreateTablet for tablet 096555264e8f4a86a99bbe2358a39746 (DEFAULT_TABLE table=test-table [id=fed28ede55374f8eb65d241a89750343]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:50:17.393400 7255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 096555264e8f4a86a99bbe2358a39746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:17.394974 7180 tablet_bootstrap.cc:492] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Bootstrap starting.
I20260809 18:50:17.395299 7180 tablet_bootstrap.cc:654] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:17.396220 7180 tablet_bootstrap.cc:492] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891: No bootstrap required, opened a new log
I20260809 18:50:17.396286 7180 ts_tablet_manager.cc:1397] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 18:50:17.396467 7180 raft_consensus.cc:348] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:50:17.396561 7180 raft_consensus.cc:374] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:17.396608 7180 raft_consensus.cc:729] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97b8b1f4e4234a799bfe7e1d6c3d0891, State: Initialized, Role: FOLLOWER
I20260809 18:50:17.396658 7180 consensus_queue.cc:260] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:50:17.396752 7180 ts_tablet_manager.cc:1428] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:17.396859 7374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.392703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:35769 (local address 127.0.0.1:34688)
0809 18:50:17.392862 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:17.392873 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:17.392916 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:17.393526 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:17.393527 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:17.393528 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:17.393567 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:17.393569 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.394477 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.394478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:17.395621 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:17.395625 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.396581 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.396582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:17.396649 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.396677 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 18:50:17.396739 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 18:50:17.396791 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136}
I20260809 18:50:17.396890 7825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.392790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34688 (local address 127.12.202.194:35769)
0809 18:50:17.393345 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:17.393350 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:17.393358 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:50:17.393394 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:17.393396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:17.393408 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:17.393641 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:17.393741 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.394390 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.395708 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.396493 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.396573 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.396637 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:17.396756 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 18:50:17.396813 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":519,"thread_start_us":170,"threads_started":1}
I20260809 18:50:17.397732 7824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.392864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35096 (local address 127.12.202.195:43405)
0809 18:50:17.393082 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:17.393086 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:17.393095 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:50:17.393125 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:17.393126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:17.393138 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:17.393204 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:17.393379 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.394575 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.396675 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.397426 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.397487 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.397520 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:17.397646 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 18:50:17.397673 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":91,"threads_started":1}
I20260809 18:50:17.397753 7823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.392742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:43405 (local address 127.0.0.1:35096)
0809 18:50:17.393008 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:17.393016 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:17.393051 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:17.393243 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:17.393244 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:17.393246 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:17.393293 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:17.393294 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.394659 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.394660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:17.396581 (+ 1921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:17.396583 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.397509 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.397510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:17.397569 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.397573 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:50:17.397638 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 18:50:17.397680 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":99,"threads_started":1}
I20260809 18:50:17.397682 7484 tablet_service.cc:1467] Processing CreateTablet for tablet 096555264e8f4a86a99bbe2358a39746 (DEFAULT_TABLE table=test-table [id=fed28ede55374f8eb65d241a89750343]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:50:17.398075 7484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 096555264e8f4a86a99bbe2358a39746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:17.398402 7704 tablet_service.cc:1467] Processing CreateTablet for tablet 096555264e8f4a86a99bbe2358a39746 (DEFAULT_TABLE table=test-table [id=fed28ede55374f8eb65d241a89750343]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:50:17.398737 7704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 096555264e8f4a86a99bbe2358a39746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:17.400956 7829 tablet_bootstrap.cc:492] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6: Bootstrap starting.
I20260809 18:50:17.401433 7830 tablet_bootstrap.cc:492] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba: Bootstrap starting.
I20260809 18:50:17.401623 7829 tablet_bootstrap.cc:654] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:17.402170 7830 tablet_bootstrap.cc:654] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:17.402354 7829 log.cc:824] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:17.402751 7830 log.cc:824] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:17.403270 7829 tablet_bootstrap.cc:492] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6: No bootstrap required, opened a new log
I20260809 18:50:17.403380 7829 ts_tablet_manager.cc:1397] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:50:17.403615 7830 tablet_bootstrap.cc:492] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba: No bootstrap required, opened a new log
I20260809 18:50:17.403671 7830 ts_tablet_manager.cc:1397] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:50:17.405171 7829 raft_consensus.cc:348] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:50:17.405332 7829 raft_consensus.cc:374] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:17.405380 7829 raft_consensus.cc:729] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83ad216d455340bf8a8a3e4332b6d5c6, State: Initialized, Role: FOLLOWER
I20260809 18:50:17.405334 7830 raft_consensus.cc:348] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:50:17.405529 7830 raft_consensus.cc:374] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:17.405495 7829 consensus_queue.cc:260] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:50:17.405570 7830 raft_consensus.cc:729] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 059c0281a1aa4f0b9d519dba0a784eba, State: Initialized, Role: FOLLOWER
I20260809 18:50:17.405681 7830 consensus_queue.cc:260] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:50:17.405779 7829 ts_tablet_manager.cc:1428] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 18:50:17.405799 7598 heartbeater.cc:503] Master 127.12.202.254:45899 was elected leader, sending a full tablet report...
I20260809 18:50:17.405975 7830 ts_tablet_manager.cc:1428] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 18:50:17.405998 7814 heartbeater.cc:503] Master 127.12.202.254:45899 was elected leader, sending a full tablet report...
I20260809 18:50:17.444252 7837 raft_consensus.cc:482] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:50:17.444440 7837 raft_consensus.cc:504] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:50:17.444772 7837 leader_election.cc:288] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83ad216d455340bf8a8a3e4332b6d5c6 (127.12.202.194:35769), 97b8b1f4e4234a799bfe7e1d6c3d0891 (127.12.202.193:38733)
I20260809 18:50:17.448189 7825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.445078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:41935 (local address 127.12.202.194:35769)
0809 18:50:17.445129 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:17.445132 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:17.445229 (+ 97us) server_negotiation.cc:407] Connection header received
0809 18:50:17.445291 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:17.445292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:17.445302 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:17.445382 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:17.445569 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.446069 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.447453 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.447795 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.447895 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.447904 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:17.448079 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 18:50:17.448118 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 18:50:17.448199 7838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.444990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:35769 (local address 127.12.202.195:41935)
0809 18:50:17.445149 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:17.445160 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:17.445229 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:17.445402 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:17.445403 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:17.445404 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:17.445496 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:17.445497 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.446151 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.446152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:17.447363 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:17.447379 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.447897 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.447898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:17.447975 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.447979 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:50:17.448051 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 18:50:17.448091 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":5,"thread_start_us":99,"threads_started":1}
I20260809 18:50:17.448422 7816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.444970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:38733 (local address 127.12.202.195:40765)
0809 18:50:17.445043 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:17.445060 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:17.445114 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:17.445357 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:17.445358 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:17.445360 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:17.445440 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:17.445442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.446122 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.446123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:17.447376 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:17.447379 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.448082 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.448083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:17.448178 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.448181 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:50:17.448245 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 18:50:17.448337 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":3}
I20260809 18:50:17.448447 7375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.445117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:40765 (local address 127.12.202.193:38733)
0809 18:50:17.445180 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:17.445183 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:17.445192 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:50:17.445224 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:17.445226 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:17.445268 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:17.445334 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:17.445516 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.446031 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.447499 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.447980 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.448048 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.448138 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:17.448259 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 18:50:17.448357 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 18:50:17.448681 7517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "096555264e8f4a86a99bbe2358a39746" candidate_uuid: "059c0281a1aa4f0b9d519dba0a784eba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" is_pre_election: true
I20260809 18:50:17.448733 7286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "096555264e8f4a86a99bbe2358a39746" candidate_uuid: "059c0281a1aa4f0b9d519dba0a784eba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" is_pre_election: true
I20260809 18:50:17.448860 7286 raft_consensus.cc:2454] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 059c0281a1aa4f0b9d519dba0a784eba in term 0.
I20260809 18:50:17.448860 7517 raft_consensus.cc:2454] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 059c0281a1aa4f0b9d519dba0a784eba in term 0.
I20260809 18:50:17.449086 7632 leader_election.cc:302] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 059c0281a1aa4f0b9d519dba0a784eba, 83ad216d455340bf8a8a3e4332b6d5c6; no voters:
I20260809 18:50:17.449208 7837 raft_consensus.cc:2781] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:50:17.449275 7837 raft_consensus.cc:482] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:50:17.449291 7837 raft_consensus.cc:3037] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:17.449983 7837 raft_consensus.cc:504] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:50:17.450184 7837 leader_election.cc:288] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [CANDIDATE]: Term 1 election: Requested vote from peers 83ad216d455340bf8a8a3e4332b6d5c6 (127.12.202.194:35769), 97b8b1f4e4234a799bfe7e1d6c3d0891 (127.12.202.193:38733)
I20260809 18:50:17.450273 7517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "096555264e8f4a86a99bbe2358a39746" candidate_uuid: "059c0281a1aa4f0b9d519dba0a784eba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83ad216d455340bf8a8a3e4332b6d5c6"
I20260809 18:50:17.450290 7286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "096555264e8f4a86a99bbe2358a39746" candidate_uuid: "059c0281a1aa4f0b9d519dba0a784eba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891"
I20260809 18:50:17.450369 7286 raft_consensus.cc:3037] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:17.450356 7517 raft_consensus.cc:3037] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:17.451090 7286 raft_consensus.cc:2454] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 059c0281a1aa4f0b9d519dba0a784eba in term 1.
I20260809 18:50:17.451172 7517 raft_consensus.cc:2454] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 059c0281a1aa4f0b9d519dba0a784eba in term 1.
I20260809 18:50:17.451292 7628 leader_election.cc:302] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 059c0281a1aa4f0b9d519dba0a784eba, 97b8b1f4e4234a799bfe7e1d6c3d0891; no voters:
I20260809 18:50:17.451385 7837 raft_consensus.cc:2781] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:50:17.451596 7837 raft_consensus.cc:686] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [term 1 LEADER]: Becoming Leader. State: Replica: 059c0281a1aa4f0b9d519dba0a784eba, State: Running, Role: LEADER
I20260809 18:50:17.451725 7837 consensus_queue.cc:237] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:50:17.452709 7048 catalog_manager.cc:5495] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba reported cstate change: term changed from 0 to 1, leader changed from <none> to 059c0281a1aa4f0b9d519dba0a784eba (127.12.202.195). New cstate: current_term: 1 leader_uuid: "059c0281a1aa4f0b9d519dba0a784eba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } health_report { overall_health: UNKNOWN } } }
I20260809 18:50:17.457737 7824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.455518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35098 (local address 127.12.202.195:43405)
0809 18:50:17.455581 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:17.455582 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:17.455591 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:50:17.455620 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:17.455620 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:17.455636 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:17.455689 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:50:17.455805 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.456258 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.457018 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:17.457200 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:17.457252 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:17.457405 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:50:17.457497 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:50:17.457554 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:17.457601 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 18:50:17.457616 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 18:50:17.459717 7517 raft_consensus.cc:1261] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6 [term 1 FOLLOWER]: Refusing update from remote peer 059c0281a1aa4f0b9d519dba0a784eba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:50:17.459717 7286 raft_consensus.cc:1261] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Refusing update from remote peer 059c0281a1aa4f0b9d519dba0a784eba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:50:17.460067 7837 consensus_queue.cc:1035] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [LEADER]: Connected to new peer: Peer: permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:50:17.460259 7841 consensus_queue.cc:1035] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [LEADER]: Connected to new peer: Peer: permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:50:17.462561 7847 mvcc.cc:205] Tried to move back new op lower bound from 7316690605912379392 to 7316690605882994688. Current Snapshot: MvccSnapshot[applied={T|T < 7316690605912379392}]
I20260809 18:50:17.465240 7048 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43404:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:50:17.465351 7048 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43404:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:50:17.466120 7048 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: Sending DeleteTablet for 3 replicas of tablet 096555264e8f4a86a99bbe2358a39746
I20260809 18:50:17.466495 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 7102
I20260809 18:50:17.466531 7704 tablet_service.cc:1514] Processing DeleteTablet for tablet 096555264e8f4a86a99bbe2358a39746 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:50:17 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:35096
I20260809 18:50:17.466626 7484 tablet_service.cc:1514] Processing DeleteTablet for tablet 096555264e8f4a86a99bbe2358a39746 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:50:17 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:34688
I20260809 18:50:17.470966 7862 tablet_replica.cc:330] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba: stopping tablet replica
I20260809 18:50:17.471069 7862 raft_consensus.cc:2229] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:50:17.471203 7862 raft_consensus.cc:2258] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:50:17.471204 7864 tablet_replica.cc:330] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6: stopping tablet replica
I20260809 18:50:17.471354 7864 raft_consensus.cc:2229] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:50:17.471505 7864 raft_consensus.cc:2258] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:50:17.471740 7862 ts_tablet_manager.cc:1905] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:50:17.472036 7864 ts_tablet_manager.cc:1905] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:50:17.473804 7862 ts_tablet_manager.cc:1918] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:50:17.473893 7862 log.cc:1196] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/096555264e8f4a86a99bbe2358a39746
I20260809 18:50:17.473969 7864 ts_tablet_manager.cc:1918] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:50:17.474109 7864 log.cc:1196] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/096555264e8f4a86a99bbe2358a39746
I20260809 18:50:17.474213 7862 ts_tablet_manager.cc:1939] T 096555264e8f4a86a99bbe2358a39746 P 059c0281a1aa4f0b9d519dba0a784eba: Deleting consensus metadata
I20260809 18:50:17.474519 7864 ts_tablet_manager.cc:1939] T 096555264e8f4a86a99bbe2358a39746 P 83ad216d455340bf8a8a3e4332b6d5c6: Deleting consensus metadata
I20260809 18:50:17.474677 7017 catalog_manager.cc:4841] TS 059c0281a1aa4f0b9d519dba0a784eba (127.12.202.195:43405): tablet 096555264e8f4a86a99bbe2358a39746 (table test-table [id=fed28ede55374f8eb65d241a89750343]) successfully deleted
I20260809 18:50:17.475054 7022 catalog_manager.cc:4841] TS 83ad216d455340bf8a8a3e4332b6d5c6 (127.12.202.194:35769): tablet 096555264e8f4a86a99bbe2358a39746 (table test-table [id=fed28ede55374f8eb65d241a89750343]) successfully deleted
W20260809 18:50:17.477422 7017 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.202.193:38733 (error 108)
I20260809 18:50:17.477682 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 7373
I20260809 18:50:17.480321 7823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:17.477866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:38733 (local address 127.0.0.1:33614)
0809 18:50:17.480211 (+ 2345us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:17.480266 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:38733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2322}
W20260809 18:50:17.480495 7017 catalog_manager.cc:4584] TS 97b8b1f4e4234a799bfe7e1d6c3d0891 (127.12.202.193:38733): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 096555264e8f4a86a99bbe2358a39746: Network error: Client connection negotiation failed: client connection to 127.12.202.193:38733: connect: Connection refused (error 111)
I20260809 18:50:17.488076 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 7605
I20260809 18:50:17.507718 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 6986
I20260809 18:50:37.521834 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:45899
--webserver_interface=127.12.202.254
--webserver_port=41603
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:45899
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:50:37.606091 7866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:37.606313 7866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:37.606336 7866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:37.607419 7866 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 18:50:37.607451 7866 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 18:50:37.607465 7866 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 18:50:37.607476 7866 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:50:37.607489 7866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:37.607502 7866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:37.607515 7866 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:50:37.607527 7866 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:50:37.609215 7866 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:45899
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:45899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=41603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7866
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:37.609419 7866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:37.609591 7866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:50:37.614904 7866 server_base.cc:1034] running on GCE node
W20260809 18:50:37.614867 7877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:37.614876 7874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:37.614910 7872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:37.615425 7866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:37.615706 7866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:37.616843 7866 hybrid_clock.cc:648] HybridClock initialized: now 1786301437616823 us; error 37 us; skew 500 ppm
Aug 09 18:50:37 dist-test-slave-45dx krb5kdc[6077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301437, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:50:37.619444 7866 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:50:37.619905 7866 webserver.cc:460] Webserver started at http://127.12.202.254:41603/ using document root <none> and password file <none>
I20260809 18:50:37.620141 7866 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:37.620187 7866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:37.621582 7866 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:50:37.622309 7887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:37.622486 7866 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:50:37.622584 7866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "57c394e9c5594afc8ca1a25b6d893f8c"
format_stamp: "Formatted at 2026-08-09 18:49:55 on dist-test-slave-45dx"
server_key: "d618c76319f1760af3bd16f4df22a607"
server_key_iv: "2c94c32ea58224c35cc926e42983a9a0"
server_key_version: "encryptionkey@0"
I20260809 18:50:37.622923 7866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:37.636041 7866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:37.638003 7866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:37.638180 7866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:37.642235 7866 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:45899
I20260809 18:50:37.642288 7975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:45899 every 8 connection(s)
I20260809 18:50:37.642675 7866 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:50:37.644225 7976 sys_catalog.cc:263] Verifying existing consensus state
I20260809 18:50:37.644954 7976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: Bootstrap starting.
I20260809 18:50:37.648484 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 7866
I20260809 18:50:37.648803 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:38733
--local_ip_for_outbound_sockets=127.12.202.193
--tserver_master_addrs=127.12.202.254:45899
--webserver_port=32993
--webserver_interface=127.12.202.193
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:50:37.655105 7976 log.cc:824] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:37.657529 7976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:50:37.657861 7976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: Bootstrap complete.
I20260809 18:50:37.660178 7976 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45899 } }
I20260809 18:50:37.660490 7976 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57c394e9c5594afc8ca1a25b6d893f8c, State: Initialized, Role: FOLLOWER
I20260809 18:50:37.660697 7976 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45899 } }
I20260809 18:50:37.660799 7976 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:50:37.660853 7976 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:50:37.660903 7976 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 2 FOLLOWER]: Advancing to term 3
I20260809 18:50:37.661906 7976 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45899 } }
I20260809 18:50:37.662025 7976 leader_election.cc:302] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57c394e9c5594afc8ca1a25b6d893f8c; no voters:
I20260809 18:50:37.662242 7976 leader_election.cc:288] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 18:50:37.662281 7981 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 3 FOLLOWER]: Leader election won for term 3
I20260809 18:50:37.662412 7981 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [term 3 LEADER]: Becoming Leader. State: Replica: 57c394e9c5594afc8ca1a25b6d893f8c, State: Running, Role: LEADER
I20260809 18:50:37.662528 7976 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:50:37.662575 7981 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45899 } }
I20260809 18:50:37.662962 7986 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57c394e9c5594afc8ca1a25b6d893f8c. Latest consensus state: current_term: 3 leader_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45899 } } }
I20260809 18:50:37.662976 7983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57c394e9c5594afc8ca1a25b6d893f8c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45899 } } }
I20260809 18:50:37.663062 7986 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [sys.catalog]: This master's current role is: LEADER
I20260809 18:50:37.663092 7983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c [sys.catalog]: This master's current role is: LEADER
I20260809 18:50:37.663873 7993 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:50:37.664894 7993 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:50:37.665019 7993 catalog_manager.cc:1259] Loaded cluster ID: 767891e48a3d4e6c9a09ccf4b7ccaca2
I20260809 18:50:37.665050 7993 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:50:37.666316 7993 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:50:37.666524 7993 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: Loaded TSK: 0
I20260809 18:50:37.666580 7993 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 57c394e9c5594afc8ca1a25b6d893f8c: Loaded TSK: 1
F20260809 18:50:37.666986 7993 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fc4da7f19ad google::LogMessage::Fail() at ??:0
@ 0x7fc4da7f488a google::LogMessage::SendToLog() at ??:0
@ 0x7fc4da7f14de google::LogMessage::Flush() at ??:0
@ 0x7fc4da7f2a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc4dcf5e104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fc4dcf5bd41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fc4e274b1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fc4e274b48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fc4e274b594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fc4e2711c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fc4e271bad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fc4dc6bf0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc4dc6b4954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc4dd5186db start_thread at ??:0
@ 0x7fc4d92ef61f clone at ??:0
W20260809 18:50:37.755931 7979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:37.756141 7979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:37.756165 7979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:37.757381 7979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:37.757428 7979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:37.757455 7979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:50:37.758970 7979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:38733
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=32993
--tserver_master_addrs=127.12.202.254:45899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:37.759227 7979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:37.759491 7979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:37.765919 8043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:37.765928 8045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:37.766031 8042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:37.766283 7979 server_base.cc:1034] running on GCE node
I20260809 18:50:37.766501 7979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:37.766810 7979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:37.768004 7979 hybrid_clock.cc:648] HybridClock initialized: now 1786301437767986 us; error 28 us; skew 500 ppm
Aug 09 18:50:37 dist-test-slave-45dx krb5kdc[6077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301437, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:50:37.771241 7979 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:50:37.771809 7979 webserver.cc:460] Webserver started at http://127.12.202.193:32993/ using document root <none> and password file <none>
I20260809 18:50:37.772135 7979 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:37.772214 7979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:37.774091 7979 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:50:37.774955 8057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:37.775161 7979 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:50:37.775277 7979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891"
format_stamp: "Formatted at 2026-08-09 18:49:55 on dist-test-slave-45dx"
server_key: "cf5269c2e3aa98b356b45b3721a2e1ee"
server_key_iv: "694b0f11f14e19ac0c777721ac99a86f"
server_key_version: "encryptionkey@0"
I20260809 18:50:37.775660 7979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:37.810123 7979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:37.812695 7979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:37.812849 7979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:37.813130 7979 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:50:37.813611 8069 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 18:50:37.815834 7979 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 18:50:37.815900 7979 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 18:50:37.815948 7979 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 18:50:37.816707 7979 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 18:50:37.816766 7979 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.001s
I20260809 18:50:37.816828 8069 tablet_bootstrap.cc:492] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Bootstrap starting.
I20260809 18:50:37.824273 7979 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:38733
I20260809 18:50:37.824452 8231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:38733 every 8 connection(s)
I20260809 18:50:37.824736 7979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:50:37.826058 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 7979
I20260809 18:50:37.826428 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:35769
--local_ip_for_outbound_sockets=127.12.202.194
--tserver_master_addrs=127.12.202.254:45899
--webserver_port=46289
--webserver_interface=127.12.202.194
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:50:37.828454 8069 log.cc:824] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:37.831135 8069 tablet_bootstrap.cc:492] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 18:50:37.831468 8069 tablet_bootstrap.cc:492] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Bootstrap complete.
I20260809 18:50:37.832805 8069 ts_tablet_manager.cc:1397] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.008s
I20260809 18:50:37.834221 8069 raft_consensus.cc:348] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:50:37.834555 8069 raft_consensus.cc:729] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97b8b1f4e4234a799bfe7e1d6c3d0891, State: Initialized, Role: FOLLOWER
I20260809 18:50:37.834728 8069 consensus_queue.cc:260] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:50:37.835033 8069 ts_tablet_manager.cc:1428] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260809 18:50:37.872638 8234 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:50:37.825517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:46909)
0809 18:50:37.825734 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:37.825770 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:37.826802 (+ 1032us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:37.872447 (+ 45645us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":136,"threads_started":1}
W20260809 18:50:37.872903 8232 heartbeater.cc:644] Failed to heartbeat to 127.12.202.254:45899 (0 consecutive failures): Network error: Failed to ping master at 127.12.202.254:45899: Client connection negotiation failed: client connection to 127.12.202.254:45899: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 18:50:37.873256 8234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:37.873137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:44597)
0809 18:50:37.873193 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:37.873236 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 18:50:37.873656 8234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:37.873570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:44637)
0809 18:50:37.873616 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:37.873639 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 18:50:37.873780 8232 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 18:50:37.916237 8236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:37.916477 8236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:37.916517 8236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:37.917649 8236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:37.917722 8236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:37.917768 8236 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:50:37.919256 8236 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:35769
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=46289
--tserver_master_addrs=127.12.202.254:45899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:37.919543 8236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:37.919776 8236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:50:37.925007 8236 server_base.cc:1034] running on GCE node
W20260809 18:50:37.925009 8250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:37.924978 8248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:37.924988 8246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:37.925411 8236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:37.925625 8236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:37.926810 8236 hybrid_clock.cc:648] HybridClock initialized: now 1786301437926786 us; error 31 us; skew 500 ppm
Aug 09 18:50:37 dist-test-slave-45dx krb5kdc[6077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301437, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:50:37.929487 8236 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:50:37.929924 8236 webserver.cc:460] Webserver started at http://127.12.202.194:46289/ using document root <none> and password file <none>
I20260809 18:50:37.930177 8236 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:37.930250 8236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:37.931661 8236 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:50:37.932271 8262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:37.932467 8236 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:50:37.932571 8236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "83ad216d455340bf8a8a3e4332b6d5c6"
format_stamp: "Formatted at 2026-08-09 18:49:56 on dist-test-slave-45dx"
server_key: "634412cb2ea8dc871305d95e88b457f5"
server_key_iv: "69b1cb2d47ff8ca60498d46bf6bea99d"
server_key_version: "encryptionkey@0"
I20260809 18:50:37.932931 8236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:37.943812 8236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:37.945850 8236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:37.946012 8236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:37.946235 8236 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:50:37.946538 8236 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:50:37.946594 8236 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:37.946635 8236 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:50:37.946664 8236 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:37.953015 8236 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:35769
I20260809 18:50:37.953091 8443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:35769 every 8 connection(s)
I20260809 18:50:37.953434 8236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:50:37.954537 8446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:37.954160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:35427)
0809 18:50:37.954325 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:37.954400 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":78,"threads_started":1}
W20260809 18:50:37.954929 8444 heartbeater.cc:644] Failed to heartbeat to 127.12.202.254:45899 (0 consecutive failures): Network error: Failed to ping master at 127.12.202.254:45899: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
I20260809 18:50:37.955225 8446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:37.955135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:40993)
0809 18:50:37.955180 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:37.955206 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 18:50:37.955476 8446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:37.955428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:49481)
0809 18:50:37.955448 (+ 20us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:37.955465 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260809 18:50:37.955590 8444 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 18:50:37.958570 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 8236
I20260809 18:50:37.958833 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:43405
--local_ip_for_outbound_sockets=127.12.202.195
--tserver_master_addrs=127.12.202.254:45899
--webserver_port=43661
--webserver_interface=127.12.202.195
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:50:38.040104 8447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:38.040364 8447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:38.040405 8447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:38.041496 8447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:38.041532 8447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:38.041558 8447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:50:38.042960 8447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:43405
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=43661
--tserver_master_addrs=127.12.202.254:45899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:38.043140 8447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:38.043335 8447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:50:38.048676 8447 server_base.cc:1034] running on GCE node
W20260809 18:50:38.048656 8456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:38.048656 8460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:38.048677 8458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:38.049115 8447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:38.049384 8447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:38.050567 8447 hybrid_clock.cc:648] HybridClock initialized: now 1786301438050560 us; error 37 us; skew 500 ppm
Aug 09 18:50:38 dist-test-slave-45dx krb5kdc[6077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301438, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:50:38.053169 8447 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:50:38.053574 8447 webserver.cc:460] Webserver started at http://127.12.202.195:43661/ using document root <none> and password file <none>
I20260809 18:50:38.053757 8447 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:38.053809 8447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:38.055141 8447 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:50:38.055722 8472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:38.055876 8447 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:50:38.055969 8447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "059c0281a1aa4f0b9d519dba0a784eba"
format_stamp: "Formatted at 2026-08-09 18:49:56 on dist-test-slave-45dx"
server_key: "7aefb78c366b4705bd8f38dea16414a1"
server_key_iv: "f63293b9e314d2234f01775763f9e81e"
server_key_version: "encryptionkey@0"
I20260809 18:50:38.056288 8447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:38.070731 8447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:38.072989 8447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:38.073102 8447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:38.073282 8447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:50:38.073628 8447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:50:38.073683 8447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:38.073740 8447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:50:38.073767 8447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:38.079569 8447 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:43405
I20260809 18:50:38.079648 8672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:43405 every 8 connection(s)
I20260809 18:50:38.079993 8447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:50:38.081058 8679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:38.080704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:40359)
0809 18:50:38.080854 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:38.080920 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":71,"threads_started":1}
W20260809 18:50:38.081461 8673 heartbeater.cc:644] Failed to heartbeat to 127.12.202.254:45899 (0 consecutive failures): Network error: Failed to ping master at 127.12.202.254:45899: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
I20260809 18:50:38.081724 8679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:38.081639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:40505)
0809 18:50:38.081680 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:38.081707 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260809 18:50:38.082052 8679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:38.081976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:44035)
0809 18:50:38.082015 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:38.082037 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260809 18:50:38.082177 8673 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 18:50:38.084492 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 8447
I20260809 18:50:38.874398 8685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:38.874151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:44661)
0809 18:50:38.874302 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:38.874343 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":64,"threads_started":1}
I20260809 18:50:38.956135 8688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:38.955922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:42033)
0809 18:50:38.956047 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:38.956084 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":60,"threads_started":1}
I20260809 18:50:39.082660 8689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:39.082468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:52647)
0809 18:50:39.082580 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:39.082614 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":58,"threads_started":1}
I20260809 18:50:39.262753 8693 raft_consensus.cc:482] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:50:39.262882 8693 raft_consensus.cc:504] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:50:39.263305 8693 leader_election.cc:288] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83ad216d455340bf8a8a3e4332b6d5c6 (127.12.202.194:35769), 059c0281a1aa4f0b9d519dba0a784eba (127.12.202.195:43405)
Aug 09 18:50:39 dist-test-slave-45dx krb5kdc[6077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301437, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.195@KRBTEST.COM
Aug 09 18:50:39 dist-test-slave-45dx krb5kdc[6077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301437, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.194@KRBTEST.COM
I20260809 18:50:39.276683 8694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:39.263455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:35769 (local address 127.12.202.193:34859)
0809 18:50:39.263624 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:39.263634 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:39.263689 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:39.264780 (+ 1091us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:39.264784 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:39.265351 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:50:39.265625 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:39.265633 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:39.267337 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:39.267338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:39.268746 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:39.268750 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:39.269587 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:39.269587 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:39.269730 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:39.270417 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:50:39.270428 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:50:39.272700 (+ 2272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:50:39.274798 (+ 2098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:39.274799 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:39.274800 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:39.275041 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:39.275279 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:39.275279 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:39.275280 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:39.275475 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:39.275975 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:50:39.275983 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:50:39.276161 (+ 178us) client_negotiation.cc:769] Sending connection context
0809 18:50:39.276329 (+ 168us) client_negotiation.cc:240] Negotiation successful
0809 18:50:39.276543 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":153,"thread_start_us":83,"threads_started":1}
I20260809 18:50:39.276708 8695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:39.263604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:39993 (local address 127.12.202.195:43405)
0809 18:50:39.263782 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:39.263794 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:39.263830 (+ 36us) server_negotiation.cc:407] Connection header received
0809 18:50:39.264450 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:39.264454 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:39.264514 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:39.264682 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:39.265790 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:39.267187 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:39.268839 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:39.269483 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:39.269600 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:39.272464 (+ 2864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:39.272468 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:39.272468 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:50:39.272478 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:39.274537 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:39.275056 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:39.275058 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:39.275058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:39.275197 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:39.275557 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:39.275558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:39.275558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:39.275903 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:39.275981 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:39.276435 (+ 454us) server_negotiation.cc:299] Negotiation successful
0809 18:50:39.276601 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":59,"threads_started":1}
I20260809 18:50:39.276717 8697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:39.263643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:34859 (local address 127.12.202.194:35769)
0809 18:50:39.263815 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:39.263822 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:39.263849 (+ 27us) server_negotiation.cc:407] Connection header received
0809 18:50:39.264451 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:39.264454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:39.264514 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:39.264682 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:39.265790 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:39.267183 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:39.268839 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:39.269483 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:39.269602 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:39.272838 (+ 3236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:39.272843 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:39.272843 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:50:39.272856 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:39.274725 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:39.275114 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:39.275116 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:39.275117 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:39.275210 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:39.275557 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:39.275558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:39.275558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:39.275887 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:39.275981 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:39.276435 (+ 454us) server_negotiation.cc:299] Negotiation successful
0809 18:50:39.276592 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":74,"threads_started":1}
I20260809 18:50:39.276692 8685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:39.263448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:43405 (local address 127.12.202.193:39993)
0809 18:50:39.263526 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:39.263537 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:39.263598 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:39.264780 (+ 1182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:39.264784 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:39.265351 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:50:39.265625 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:39.265633 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:39.267318 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:39.267319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:39.268746 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:39.268750 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:39.269585 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:39.269586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:39.269730 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:39.270427 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:50:39.270432 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:50:39.272224 (+ 1792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:50:39.274621 (+ 2397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:39.274628 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:39.274629 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:39.274976 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:39.275279 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:39.275279 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:39.275280 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:39.275475 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:39.275975 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:50:39.275983 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:50:39.276161 (+ 178us) client_negotiation.cc:769] Sending connection context
0809 18:50:39.276321 (+ 160us) client_negotiation.cc:240] Negotiation successful
0809 18:50:39.276601 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":228}
W20260809 18:50:39.277889 8059 leader_election.cc:341] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 059c0281a1aa4f0b9d519dba0a784eba (127.12.202.195:43405): Not found: Tablet not found: 096555264e8f4a86a99bbe2358a39746
W20260809 18:50:39.277982 8063 leader_election.cc:341] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83ad216d455340bf8a8a3e4332b6d5c6 (127.12.202.194:35769): Not found: Tablet not found: 096555264e8f4a86a99bbe2358a39746
I20260809 18:50:39.278021 8063 leader_election.cc:302] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97b8b1f4e4234a799bfe7e1d6c3d0891; no voters: 059c0281a1aa4f0b9d519dba0a784eba, 83ad216d455340bf8a8a3e4332b6d5c6
I20260809 18:50:39.278169 8693 raft_consensus.cc:2726] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:50:39.875177 8699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:39.874944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:34379)
0809 18:50:39.875088 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:39.875127 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":73,"threads_started":1}
I20260809 18:50:39.956772 8701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:39.956589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:43129)
0809 18:50:39.956701 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:39.956735 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":57,"threads_started":1}
I20260809 18:50:40.083299 8703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:40.083090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:52819)
0809 18:50:40.083227 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:40.083262 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":75,"threads_started":1}
I20260809 18:50:40.875936 8704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:40.875674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:59901)
0809 18:50:40.875841 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:40.875883 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":67,"threads_started":1}
I20260809 18:50:40.957612 8706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:40.957227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:33559)
0809 18:50:40.957517 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:40.957564 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":61,"threads_started":1}
I20260809 18:50:41.006878 8707 raft_consensus.cc:482] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:50:41.006982 8707 raft_consensus.cc:504] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:50:41.007153 8707 leader_election.cc:288] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83ad216d455340bf8a8a3e4332b6d5c6 (127.12.202.194:35769), 059c0281a1aa4f0b9d519dba0a784eba (127.12.202.195:43405)
W20260809 18:50:41.007612 8059 leader_election.cc:341] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 059c0281a1aa4f0b9d519dba0a784eba (127.12.202.195:43405): Not found: Tablet not found: 096555264e8f4a86a99bbe2358a39746
W20260809 18:50:41.007714 8063 leader_election.cc:341] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83ad216d455340bf8a8a3e4332b6d5c6 (127.12.202.194:35769): Not found: Tablet not found: 096555264e8f4a86a99bbe2358a39746
I20260809 18:50:41.007803 8063 leader_election.cc:302] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97b8b1f4e4234a799bfe7e1d6c3d0891; no voters: 059c0281a1aa4f0b9d519dba0a784eba, 83ad216d455340bf8a8a3e4332b6d5c6
I20260809 18:50:41.007922 8707 raft_consensus.cc:2726] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:50:41.083936 8708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:41.083704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:59607)
0809 18:50:41.083856 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:41.083894 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":75,"threads_started":1}
I20260809 18:50:41.876668 8710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:41.876460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:50679)
0809 18:50:41.876581 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:41.876618 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":67,"threads_started":1}
I20260809 18:50:41.958278 8711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:41.958069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:52853)
0809 18:50:41.958195 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:41.958234 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":64,"threads_started":1}
I20260809 18:50:42.084682 8712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:42.084437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:37729)
0809 18:50:42.084597 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:42.084637 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":77,"threads_started":1}
I20260809 18:50:42.877377 8713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:42.877141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:36227)
0809 18:50:42.877279 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:42.877327 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":83,"threads_started":1}
I20260809 18:50:42.958990 8714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:42.958789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:60793)
0809 18:50:42.958909 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:42.958947 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":64,"threads_started":1}
I20260809 18:50:43.085305 8715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:43.085094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:44663)
0809 18:50:43.085227 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:43.085262 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":77,"threads_started":1}
I20260809 18:50:43.878001 8717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:43.877765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:41657)
0809 18:50:43.877920 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:43.877951 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":82,"threads_started":1}
I20260809 18:50:43.959643 8718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:43.959457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:59419)
0809 18:50:43.959566 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:43.959601 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":57,"threads_started":1}
I20260809 18:50:44.085927 8719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:44.085701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:44205)
0809 18:50:44.085847 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:44.085882 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":62,"threads_started":1}
I20260809 18:50:44.240183 8720 raft_consensus.cc:482] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:50:44.240278 8720 raft_consensus.cc:504] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:50:44.240545 8720 leader_election.cc:288] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83ad216d455340bf8a8a3e4332b6d5c6 (127.12.202.194:35769), 059c0281a1aa4f0b9d519dba0a784eba (127.12.202.195:43405)
W20260809 18:50:44.240936 8059 leader_election.cc:341] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 059c0281a1aa4f0b9d519dba0a784eba (127.12.202.195:43405): Not found: Tablet not found: 096555264e8f4a86a99bbe2358a39746
W20260809 18:50:44.241029 8063 leader_election.cc:341] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83ad216d455340bf8a8a3e4332b6d5c6 (127.12.202.194:35769): Not found: Tablet not found: 096555264e8f4a86a99bbe2358a39746
I20260809 18:50:44.241118 8063 leader_election.cc:302] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97b8b1f4e4234a799bfe7e1d6c3d0891; no voters: 059c0281a1aa4f0b9d519dba0a784eba, 83ad216d455340bf8a8a3e4332b6d5c6
I20260809 18:50:44.241201 8720 raft_consensus.cc:2726] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:50:44.878717 8723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:44.878458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:41567)
0809 18:50:44.878599 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:44.878630 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":68,"threads_started":1}
I20260809 18:50:44.960470 8725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:44.960175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:39629)
0809 18:50:44.960376 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:44.960419 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":85,"threads_started":1}
I20260809 18:50:45.086588 8726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:45.086375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:36647)
0809 18:50:45.086503 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:45.086541 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":62,"threads_started":1}
I20260809 18:50:45.879485 8728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:45.879223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:41539)
0809 18:50:45.879403 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:45.879435 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":114,"threads_started":1}
I20260809 18:50:45.961263 8729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:45.960986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:59693)
0809 18:50:45.961159 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:45.961210 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":83,"threads_started":1}
I20260809 18:50:46.087284 8730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:46.087049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:58335)
0809 18:50:46.087195 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:46.087233 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":66,"threads_started":1}
I20260809 18:50:46.880180 8731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:46.879955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:56465)
0809 18:50:46.880087 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:46.880127 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":69,"threads_started":1}
I20260809 18:50:46.961959 8732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:46.961742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:54345)
0809 18:50:46.961877 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:46.961913 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":67,"threads_started":1}
I20260809 18:50:47.088006 8734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:47.087771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:34113)
0809 18:50:47.087917 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:47.087959 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":68,"threads_started":1}
I20260809 18:50:47.880913 8735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:47.880691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:43375)
0809 18:50:47.880819 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:47.880861 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":66,"threads_started":1}
I20260809 18:50:47.962724 8736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:47.962474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:39993)
0809 18:50:47.962628 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:47.962673 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":63,"threads_started":1}
I20260809 18:50:48.038950 8738 raft_consensus.cc:482] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:50:48.039059 8738 raft_consensus.cc:504] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83ad216d455340bf8a8a3e4332b6d5c6" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 35769 } } peers { permanent_uuid: "059c0281a1aa4f0b9d519dba0a784eba" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 43405 } } peers { permanent_uuid: "97b8b1f4e4234a799bfe7e1d6c3d0891" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 38733 } }
I20260809 18:50:48.039233 8738 leader_election.cc:288] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83ad216d455340bf8a8a3e4332b6d5c6 (127.12.202.194:35769), 059c0281a1aa4f0b9d519dba0a784eba (127.12.202.195:43405)
W20260809 18:50:48.039662 8059 leader_election.cc:341] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 059c0281a1aa4f0b9d519dba0a784eba (127.12.202.195:43405): Not found: Tablet not found: 096555264e8f4a86a99bbe2358a39746
W20260809 18:50:48.039752 8063 leader_election.cc:341] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83ad216d455340bf8a8a3e4332b6d5c6 (127.12.202.194:35769): Not found: Tablet not found: 096555264e8f4a86a99bbe2358a39746
I20260809 18:50:48.039834 8063 leader_election.cc:302] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97b8b1f4e4234a799bfe7e1d6c3d0891; no voters: 059c0281a1aa4f0b9d519dba0a784eba, 83ad216d455340bf8a8a3e4332b6d5c6
I20260809 18:50:48.039927 8738 raft_consensus.cc:2726] T 096555264e8f4a86a99bbe2358a39746 P 97b8b1f4e4234a799bfe7e1d6c3d0891 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 18:50:48.088785 8740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:48.088552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:44885)
0809 18:50:48.088678 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:48.088717 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":64,"threads_started":1}
I20260809 18:50:48.881702 8741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:48.881431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:52585)
0809 18:50:48.881609 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:48.881650 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":103,"threads_started":1}
I20260809 18:50:48.963541 8742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:48.963320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:55123)
0809 18:50:48.963451 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:48.963492 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":67,"threads_started":1}
I20260809 18:50:49.089447 8743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:49.089223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:36757)
0809 18:50:49.089360 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:49.089404 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":78,"threads_started":1}
I20260809 18:50:49.882426 8745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:49.882207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:42125)
0809 18:50:49.882336 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:49.882374 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":61,"threads_started":1}
I20260809 18:50:49.964229 8746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:49.964002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:48415)
0809 18:50:49.964147 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:49.964185 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":77,"threads_started":1}
I20260809 18:50:50.090124 8747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:50.089901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:36551)
0809 18:50:50.090032 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:50.090075 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":61,"threads_started":1}
I20260809 18:50:50.883145 8751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:50.882904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:56499)
0809 18:50:50.883062 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:50.883094 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":92,"threads_started":1}
I20260809 18:50:50.965024 8752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:50.964754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:52571)
0809 18:50:50.964927 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:50.964973 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":102,"threads_started":1}
I20260809 18:50:51.090898 8753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:51.090632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:47037)
0809 18:50:51.090760 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:51.090820 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":65,"threads_started":1}
I20260809 18:50:51.883833 8754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:51.883587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:43057)
0809 18:50:51.883745 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:51.883777 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":101,"threads_started":1}
I20260809 18:50:51.965732 8755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:51.965499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:51155)
0809 18:50:51.965640 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:51.965679 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":82,"threads_started":1}
I20260809 18:50:52.091668 8756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:52.091442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:44811)
0809 18:50:52.091584 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:52.091616 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":87,"threads_started":1}
I20260809 18:50:52.884680 8758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:52.884454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.193:47079)
0809 18:50:52.884590 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:52.884630 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":65,"threads_started":1}
I20260809 18:50:52.966475 8759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:52.966235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.194:56771)
0809 18:50:52.966380 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:52.966423 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":79,"threads_started":1}
I20260809 18:50:53.089397 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 7979
I20260809 18:50:53.095367 8762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:53.095157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:45899 (local address 127.12.202.195:43973)
0809 18:50:53.095278 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:53.095320 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.254:45899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":77,"threads_started":1}
I20260809 18:50:53.100245 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 8236
I20260809 18:50:53.111563 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 8447
2026-08-09T18:50:53Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58878 ms)
[----------] 30 tests from SecurityITest (268449 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:50:53 dist-test-slave-45dx krb5kdc[8770](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:50:53 dist-test-slave-45dx krb5kdc[8770](info): set up 2 sockets
Aug 09 18:50:53 dist-test-slave-45dx krb5kdc[8770](info): commencing operation
krb5kdc: starting...
W20260809 18:50:54.378773 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:50:54 dist-test-slave-45dx krb5kdc[8770](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301454, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:50:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:50:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:50:54.502532 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:37707
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:42245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:37707
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:50:54.583802 8789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:54.584017 8789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:54.584041 8789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:54.585273 8789 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:50:54.585318 8789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:54.585332 8789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:54.585345 8789 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:50:54.585357 8789 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:50:54.586849 8789 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:42245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:37707
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:37707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8789
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:54.587085 8789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:54.587280 8789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:54.592181 8798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:54.592195 8800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:54.592470 8789 server_base.cc:1034] running on GCE node
W20260809 18:50:54.592186 8802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:54.592788 8789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:54.593097 8789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:54.594267 8789 hybrid_clock.cc:648] HybridClock initialized: now 1786301454594258 us; error 35 us; skew 500 ppm
Aug 09 18:50:54 dist-test-slave-45dx krb5kdc[8770](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301454, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:50:54.597012 8789 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:50:54.597527 8789 webserver.cc:460] Webserver started at http://127.12.202.254:33341/ using document root <none> and password file <none>
I20260809 18:50:54.597815 8789 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:54.597867 8789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:54.598004 8789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:50:54.599071 8789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "bb50bc3e0c424be1b2aa251420c56725"
format_stamp: "Formatted at 2026-08-09 18:50:54 on dist-test-slave-45dx"
server_key: "3fa0556cf46627b789559b58147e5f7e"
server_key_iv: "527ca80b5a088d4aa0e71cf4785a084d"
server_key_version: "encryptionkey@0"
I20260809 18:50:54.599443 8789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "bb50bc3e0c424be1b2aa251420c56725"
format_stamp: "Formatted at 2026-08-09 18:50:54 on dist-test-slave-45dx"
server_key: "3fa0556cf46627b789559b58147e5f7e"
server_key_iv: "527ca80b5a088d4aa0e71cf4785a084d"
server_key_version: "encryptionkey@0"
I20260809 18:50:54.600951 8789 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:50:54.601759 8811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:54.602013 8789 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:50:54.602131 8789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "bb50bc3e0c424be1b2aa251420c56725"
format_stamp: "Formatted at 2026-08-09 18:50:54 on dist-test-slave-45dx"
server_key: "3fa0556cf46627b789559b58147e5f7e"
server_key_iv: "527ca80b5a088d4aa0e71cf4785a084d"
server_key_version: "encryptionkey@0"
I20260809 18:50:54.602210 8789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:54.630685 8789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:54.632782 8789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:54.632963 8789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:54.637442 8789 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:37707
I20260809 18:50:54.637496 8906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:37707 every 8 connection(s)
I20260809 18:50:54.637895 8789 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:50:54.638763 8908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:54.641173 8908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725: Bootstrap starting.
I20260809 18:50:54.641878 8908 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:54.642179 8908 log.cc:824] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:54.642856 8908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725: No bootstrap required, opened a new log
I20260809 18:50:54.644444 8908 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb50bc3e0c424be1b2aa251420c56725" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 37707 } }
I20260809 18:50:54.644577 8908 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:54.644599 8908 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb50bc3e0c424be1b2aa251420c56725, State: Initialized, Role: FOLLOWER
I20260809 18:50:54.644774 8908 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb50bc3e0c424be1b2aa251420c56725" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 37707 } }
I20260809 18:50:54.644834 8908 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:50:54.644876 8908 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:50:54.644927 8908 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:54.645438 8908 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb50bc3e0c424be1b2aa251420c56725" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 37707 } }
I20260809 18:50:54.645548 8908 leader_election.cc:302] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb50bc3e0c424be1b2aa251420c56725; no voters:
I20260809 18:50:54.645732 8908 leader_election.cc:288] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:50:54.645771 8911 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:50:54.645972 8911 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725 [term 1 LEADER]: Becoming Leader. State: Replica: bb50bc3e0c424be1b2aa251420c56725, State: Running, Role: LEADER
I20260809 18:50:54.645993 8908 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:50:54.646057 8911 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb50bc3e0c424be1b2aa251420c56725" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 37707 } }
I20260809 18:50:54.646672 8912 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb50bc3e0c424be1b2aa251420c56725" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb50bc3e0c424be1b2aa251420c56725" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 37707 } } }
I20260809 18:50:54.646782 8912 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725 [sys.catalog]: This master's current role is: LEADER
I20260809 18:50:54.647208 8921 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:50:54.647197 8913 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb50bc3e0c424be1b2aa251420c56725. Latest consensus state: current_term: 1 leader_uuid: "bb50bc3e0c424be1b2aa251420c56725" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb50bc3e0c424be1b2aa251420c56725" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 37707 } } }
I20260809 18:50:54.647359 8913 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725 [sys.catalog]: This master's current role is: LEADER
I20260809 18:50:54.647725 8921 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:50:54.647967 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 8789
I20260809 18:50:54.648084 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:50:54.648286 13099 external_mini_cluster.cc:1428] Setting key 158a7f46de4c0d9da37fb1723e547554
I20260809 18:50:54.649593 8921 catalog_manager.cc:1347] Generated new cluster ID: 0f10d7c486424ed5998d97af7348fa3e
I20260809 18:50:54.649648 8921 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:50:54 dist-test-slave-45dx krb5kdc[8770](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301454, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:50:54.661767 8934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:54.648744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56498 (local address 127.12.202.254:37707)
0809 18:50:54.648918 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:54.648926 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:54.652542 (+ 3616us) server_negotiation.cc:407] Connection header received
0809 18:50:54.652700 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:54.652706 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:54.652748 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:54.652874 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:54.653493 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:54.654731 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:54.655489 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:54.655885 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:54.656022 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:54.658462 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:54.658466 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:54.658466 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:50:54.658478 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:54.660212 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:54.660614 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:54.660617 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:54.660618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:54.660723 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:54.660936 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:54.660937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:54.660938 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:54.661174 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:54.661332 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:54.661412 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 18:50:54.661547 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":85,"threads_started":1}
I20260809 18:50:54.667678 8921 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:50:54.668171 8921 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:50:54.671319 8921 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725: Generated new TSK 0
I20260809 18:50:54.671482 8921 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
I20260809 18:50:54.707274 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:37707
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:42245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:50:54.814638 8943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:54.814831 8943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:54.814852 8943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:54.815866 8943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:54.815900 8943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:54.815925 8943 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:50:54.817312 8943 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:42245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:37707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:54.817497 8943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:54.817669 8943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:54.822969 8949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:54.823040 8943 server_base.cc:1034] running on GCE node
W20260809 18:50:54.823143 8951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:54.823175 8954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:54.823469 8943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:54.823755 8943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:54.824925 8943 hybrid_clock.cc:648] HybridClock initialized: now 1786301454824923 us; error 42 us; skew 500 ppm
Aug 09 18:50:54 dist-test-slave-45dx krb5kdc[8770](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301454, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:50:54.827528 8943 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:50:54.827965 8943 webserver.cc:460] Webserver started at http://127.12.202.193:40681/ using document root <none> and password file <none>
I20260809 18:50:54.828207 8943 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:54.828275 8943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:54.828440 8943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:50:54.829483 8943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "11232fe2867444ecacd32c228deebcdd"
format_stamp: "Formatted at 2026-08-09 18:50:54 on dist-test-slave-45dx"
server_key: "65f437a641de9fbfd5f7aa198a3e69bf"
server_key_iv: "bca1cf5e2ddb8de0701471bd2c8a880a"
server_key_version: "encryptionkey@0"
I20260809 18:50:54.829846 8943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "11232fe2867444ecacd32c228deebcdd"
format_stamp: "Formatted at 2026-08-09 18:50:54 on dist-test-slave-45dx"
server_key: "65f437a641de9fbfd5f7aa198a3e69bf"
server_key_iv: "bca1cf5e2ddb8de0701471bd2c8a880a"
server_key_version: "encryptionkey@0"
I20260809 18:50:54.831229 8943 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:50:54.831996 8966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:54.832188 8943 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:50:54.832293 8943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "11232fe2867444ecacd32c228deebcdd"
format_stamp: "Formatted at 2026-08-09 18:50:54 on dist-test-slave-45dx"
server_key: "65f437a641de9fbfd5f7aa198a3e69bf"
server_key_iv: "bca1cf5e2ddb8de0701471bd2c8a880a"
server_key_version: "encryptionkey@0"
I20260809 18:50:54.832417 8943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:54.845506 8943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:54.847967 8943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:54.848124 8943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:54.848433 8943 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:50:54.848786 8943 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:50:54.848842 8943 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:54.848887 8943 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:50:54.848924 8943 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:54.854972 8943 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:44199
I20260809 18:50:54.855077 9161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:44199 every 8 connection(s)
I20260809 18:50:54.855373 8943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
Aug 09 18:50:54 dist-test-slave-45dx krb5kdc[8770](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301454, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:50:54.863772 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 8943
I20260809 18:50:54.863894 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:50:54.864128 13099 external_mini_cluster.cc:1428] Setting key 4fde1d8c6bf4b595ffdd8033a0144395
I20260809 18:50:54.865255 9165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:54.856108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:37707 (local address 127.12.202.193:51779)
0809 18:50:54.856324 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:54.856382 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:54.856911 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:54.857175 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:54.857179 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:54.857781 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:50:54.857978 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:54.857983 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:54.858708 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:54.858709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:54.859513 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:54.859516 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:54.859947 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:54.859948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:54.860078 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:54.860568 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:50:54.860576 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:50:54.861949 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:50:54.863672 (+ 1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:54.863677 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:54.863679 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:54.863965 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:54.864187 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:54.864188 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:54.864189 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:54.864366 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:54.864658 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:50:54.864665 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:50:54.864824 (+ 159us) client_negotiation.cc:769] Sending connection context
0809 18:50:54.864947 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 18:50:54.865090 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":108,"threads_started":1}
I20260809 18:50:54.865249 8934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:54.856151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:51779 (local address 127.12.202.254:37707)
0809 18:50:54.856221 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:54.856223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:54.856480 (+ 257us) server_negotiation.cc:407] Connection header received
0809 18:50:54.857019 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:54.857021 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:54.857038 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:54.857103 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:54.858096 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:54.858610 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:54.859611 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:54.859840 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:54.859933 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:54.862041 (+ 2108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:54.862042 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:54.862043 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:50:54.862050 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:54.863583 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:54.864032 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:54.864033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:54.864034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:54.864101 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:54.864447 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:54.864449 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:54.864449 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:54.864590 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:54.864646 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:54.865006 (+ 360us) server_negotiation.cc:299] Negotiation successful
0809 18:50:54.865107 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 18:50:54.866098 9162 heartbeater.cc:347] Connected to a master server at 127.12.202.254:37707
I20260809 18:50:54.866214 9162 heartbeater.cc:464] Registering TS with master...
I20260809 18:50:54.866416 9162 heartbeater.cc:511] Master 127.12.202.254:37707 requested a full tablet report, sending...
I20260809 18:50:54.867023 8838 ts_manager.cc:194] Registered new tserver with Master: 11232fe2867444ecacd32c228deebcdd (127.12.202.193:44199)
I20260809 18:50:54.867635 8838 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:51779
WARNING: no policy specified for kudu/127.12.202.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
I20260809 18:50:54.889240 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:37707
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:42245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:50:54.972432 9169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:54.972656 9169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:54.972694 9169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:54.973861 9169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:54.973929 9169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:54.973971 9169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:50:54.975395 9169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:42245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:37707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:54.975662 9169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:54.975900 9169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:54.980887 9180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:54.980913 9177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:54.980935 9176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:54.981151 9169 server_base.cc:1034] running on GCE node
I20260809 18:50:54.981357 9169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:54.981619 9169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:54.982785 9169 hybrid_clock.cc:648] HybridClock initialized: now 1786301454982760 us; error 36 us; skew 500 ppm
Aug 09 18:50:54 dist-test-slave-45dx krb5kdc[8770](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301454, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:50:54.985415 9169 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:50:54.985833 9169 webserver.cc:460] Webserver started at http://127.12.202.194:36357/ using document root <none> and password file <none>
I20260809 18:50:54.986094 9169 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:54.986164 9169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:54.986312 9169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:50:54.987342 9169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "429d2e9201774a6aa70ecd52a02a5042"
format_stamp: "Formatted at 2026-08-09 18:50:54 on dist-test-slave-45dx"
server_key: "5ba1b5611af28806dc6be82ce85a1404"
server_key_iv: "8ebac346f35a449ce3be3f343808531a"
server_key_version: "encryptionkey@0"
I20260809 18:50:54.987699 9169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "429d2e9201774a6aa70ecd52a02a5042"
format_stamp: "Formatted at 2026-08-09 18:50:54 on dist-test-slave-45dx"
server_key: "5ba1b5611af28806dc6be82ce85a1404"
server_key_iv: "8ebac346f35a449ce3be3f343808531a"
server_key_version: "encryptionkey@0"
I20260809 18:50:54.989168 9169 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:50:54.989943 9191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:54.990120 9169 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:50:54.990213 9169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "429d2e9201774a6aa70ecd52a02a5042"
format_stamp: "Formatted at 2026-08-09 18:50:54 on dist-test-slave-45dx"
server_key: "5ba1b5611af28806dc6be82ce85a1404"
server_key_iv: "8ebac346f35a449ce3be3f343808531a"
server_key_version: "encryptionkey@0"
I20260809 18:50:54.990294 9169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:55.000877 9169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:55.002739 9169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:55.002902 9169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:55.003139 9169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:50:55.003433 9169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:50:55.003490 9169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:55.003532 9169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:50:55.003558 9169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:55.009559 9169 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:45577
I20260809 18:50:55.009600 9382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:45577 every 8 connection(s)
I20260809 18:50:55.009929 9169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:50:55.014417 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 9169
I20260809 18:50:55.014542 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:50:55.014771 13099 external_mini_cluster.cc:1428] Setting key 718b9f4b30d8a22cf641c206c2703e2e
Aug 09 18:50:55 dist-test-slave-45dx krb5kdc[8770](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301454, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:50:55.019133 8934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.010668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:38567 (local address 127.12.202.254:37707)
0809 18:50:55.010733 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:55.010735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:55.010949 (+ 214us) server_negotiation.cc:407] Connection header received
0809 18:50:55.011404 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:55.011405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:55.011414 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:55.011486 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:55.012472 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.012952 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.013878 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.014060 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.014110 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.016399 (+ 2289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:55.016400 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:55.016401 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:50:55.016408 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:55.017735 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:55.018133 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:55.018134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:55.018135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:55.018198 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:55.018458 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:55.018459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:55.018459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:55.018570 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:55.018645 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:55.018923 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 18:50:55.019043 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 18:50:55.019310 9389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.010654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:37707 (local address 127.12.202.194:38567)
0809 18:50:55.010826 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:55.010866 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:55.011327 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:55.011541 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:55.011544 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:55.012129 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:50:55.012374 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:55.012381 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.013031 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.013032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:55.013802 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:55.013804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.014132 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.014133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:55.014225 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.014724 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:50:55.014733 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:50:55.016253 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:50:55.017820 (+ 1567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:55.017828 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:55.017830 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:55.018055 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:55.018264 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:55.018265 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:55.018265 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:55.018379 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:55.018634 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:50:55.018641 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:50:55.018790 (+ 149us) client_negotiation.cc:769] Sending connection context
0809 18:50:55.018902 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 18:50:55.019051 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":99,"threads_started":1}
I20260809 18:50:55.019944 9386 heartbeater.cc:347] Connected to a master server at 127.12.202.254:37707
I20260809 18:50:55.020038 9386 heartbeater.cc:464] Registering TS with master...
I20260809 18:50:55.020203 9386 heartbeater.cc:511] Master 127.12.202.254:37707 requested a full tablet report, sending...
I20260809 18:50:55.020624 8838 ts_manager.cc:194] Registered new tserver with Master: 429d2e9201774a6aa70ecd52a02a5042 (127.12.202.194:45577)
I20260809 18:50:55.021168 8838 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:38567
WARNING: no policy specified for kudu/127.12.202.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
I20260809 18:50:55.041343 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:37707
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:42245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:50:55.125664 9393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:55.125892 9393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:55.125917 9393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:55.126986 9393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:55.127022 9393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:55.127048 9393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:50:55.128521 9393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:42245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:37707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:55.128717 9393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:55.128912 9393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:55.134241 9402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:55.134231 9398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:55.134351 9393 server_base.cc:1034] running on GCE node
W20260809 18:50:55.134246 9405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:55.134795 9393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:55.135066 9393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:55.136233 9393 hybrid_clock.cc:648] HybridClock initialized: now 1786301455136224 us; error 40 us; skew 500 ppm
Aug 09 18:50:55 dist-test-slave-45dx krb5kdc[8770](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301455, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:50:55.138903 9393 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:50:55.139356 9393 webserver.cc:460] Webserver started at http://127.12.202.195:44559/ using document root <none> and password file <none>
I20260809 18:50:55.139599 9393 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:55.139668 9393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:55.139822 9393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:50:55.140975 9393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "3d30871760a544fabd217d405e92adc5"
format_stamp: "Formatted at 2026-08-09 18:50:55 on dist-test-slave-45dx"
server_key: "ac6017791159703579b64e7cc3fb67f5"
server_key_iv: "1692a9b9cdf097f88aa8a9afa056fa7d"
server_key_version: "encryptionkey@0"
I20260809 18:50:55.141360 9393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "3d30871760a544fabd217d405e92adc5"
format_stamp: "Formatted at 2026-08-09 18:50:55 on dist-test-slave-45dx"
server_key: "ac6017791159703579b64e7cc3fb67f5"
server_key_iv: "1692a9b9cdf097f88aa8a9afa056fa7d"
server_key_version: "encryptionkey@0"
I20260809 18:50:55.142828 9393 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:50:55.143584 9416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:55.143750 9393 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:50:55.143863 9393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "3d30871760a544fabd217d405e92adc5"
format_stamp: "Formatted at 2026-08-09 18:50:55 on dist-test-slave-45dx"
server_key: "ac6017791159703579b64e7cc3fb67f5"
server_key_iv: "1692a9b9cdf097f88aa8a9afa056fa7d"
server_key_version: "encryptionkey@0"
I20260809 18:50:55.143941 9393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:55.159252 9393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:55.161249 9393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:55.161427 9393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:55.161728 9393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:50:55.162159 9393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:50:55.162199 9393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:55.162222 9393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:50:55.162235 9393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:55.168529 9393 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:45245
I20260809 18:50:55.168615 9610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:45245 every 8 connection(s)
I20260809 18:50:55.168938 9393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:50:55 dist-test-slave-45dx krb5kdc[8770](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301455, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:50:55.176452 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 9393
I20260809 18:50:55.176565 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:50:55.176770 13099 external_mini_cluster.cc:1428] Setting key 864a3d533b735a1f539c6456e9d14ddf
I20260809 18:50:55.178966 8934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.169696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:39327 (local address 127.12.202.254:37707)
0809 18:50:55.169771 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:55.169773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:55.170016 (+ 243us) server_negotiation.cc:407] Connection header received
0809 18:50:55.170570 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:55.170572 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:55.170586 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:55.170644 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:55.171669 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.172178 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.173256 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.173473 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.173561 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.175769 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:55.175771 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:55.175772 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:50:55.175781 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:55.177517 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:55.177945 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:55.177946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:55.177947 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:55.178008 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:55.178276 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:55.178284 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:55.178284 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:55.178410 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:55.178487 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:55.178788 (+ 301us) server_negotiation.cc:299] Negotiation successful
0809 18:50:55.178873 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 18:50:55.179198 9615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.169660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:37707 (local address 127.12.202.195:39327)
0809 18:50:55.169881 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:55.169918 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:55.170450 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:55.170715 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:55.170721 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:55.171325 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:50:55.171561 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:55.171567 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.172280 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.172281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:55.173154 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:55.173156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.173575 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.173575 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:55.173705 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.174267 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:50:55.174275 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:50:55.175666 (+ 1391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:50:55.177616 (+ 1950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:55.177623 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:55.177625 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:55.177863 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:55.178086 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:55.178087 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:55.178088 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:55.178204 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:55.178491 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:50:55.178498 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:50:55.178640 (+ 142us) client_negotiation.cc:769] Sending connection context
0809 18:50:55.178746 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 18:50:55.178919 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":105,"threads_started":1}
I20260809 18:50:55.179713 9611 heartbeater.cc:347] Connected to a master server at 127.12.202.254:37707
I20260809 18:50:55.179801 9611 heartbeater.cc:464] Registering TS with master...
I20260809 18:50:55.180011 9611 heartbeater.cc:511] Master 127.12.202.254:37707 requested a full tablet report, sending...
I20260809 18:50:55.180447 8838 ts_manager.cc:194] Registered new tserver with Master: 3d30871760a544fabd217d405e92adc5 (127.12.202.195:45245)
I20260809 18:50:55.180822 8838 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:39327
I20260809 18:50:55.188719 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:50:55.196710 8934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.190175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56500 (local address 127.12.202.254:37707)
0809 18:50:55.190245 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:55.190247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:55.190400 (+ 153us) server_negotiation.cc:407] Connection header received
0809 18:50:55.190443 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:55.190444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:55.190453 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:55.190506 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:55.191072 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.191548 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.192413 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.192619 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.192681 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.194021 (+ 1340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:55.194023 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:55.194023 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:50:55.194031 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:55.195431 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:55.195764 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:55.195765 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:55.195765 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:55.195844 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:55.196054 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:55.196055 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:55.196055 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:55.196256 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:55.196447 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:55.196566 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 18:50:55.196639 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 18:50:55.198508 8838 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56500:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:50:55.200146 8838 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:50:55.207374 9628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.202646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:45577 (local address 127.0.0.1:60570)
0809 18:50:55.202820 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:55.202862 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:55.202930 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:55.203671 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:55.203672 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:55.203674 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:55.203744 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:55.203745 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.205048 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.205049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:55.206133 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:55.206135 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.207041 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.207042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:55.207120 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.207136 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 18:50:55.207210 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 18:50:55.207266 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":77,"threads_started":1}
I20260809 18:50:55.207381 9637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.203004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60570 (local address 127.12.202.194:45577)
0809 18:50:55.203516 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:55.203520 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:55.203529 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:50:55.203568 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:55.203570 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:55.203585 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:55.203658 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:55.203826 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.204932 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.206208 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.206932 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.207038 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.207085 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:55.207240 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 18:50:55.207286 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":96,"threads_started":1}
I20260809 18:50:55.207399 9630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.202868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:44199 (local address 127.0.0.1:50696)
0809 18:50:55.203106 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:55.203115 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:55.203153 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:55.203575 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:55.203576 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:55.203578 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:55.203613 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:55.203614 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.204663 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.204664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:55.206076 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:55.206080 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.207107 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.207108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:55.207173 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.207176 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:50:55.207249 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 18:50:55.207291 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":23,"thread_start_us":66,"threads_started":1}
I20260809 18:50:55.207671 9636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.202992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50696 (local address 127.12.202.193:44199)
0809 18:50:55.203198 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:55.203203 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:55.203213 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:50:55.203257 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:55.203259 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:55.203271 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:55.203392 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:55.203692 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.204560 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.206153 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.206926 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.207008 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.207071 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:55.207495 (+ 424us) server_negotiation.cc:299] Negotiation successful
0809 18:50:55.207540 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":90,"threads_started":1}
I20260809 18:50:55.208128 9635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.202646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:45245 (local address 127.0.0.1:48226)
0809 18:50:55.202987 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:55.202996 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:55.203036 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:55.203409 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:55.203412 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:55.203415 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:55.203488 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:55.203491 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.206227 (+ 2736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.206228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:55.206885 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:55.206886 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.207895 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.207896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:55.207957 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.207962 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 18:50:55.208010 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 18:50:55.208048 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":2,"thread_start_us":63,"threads_started":1}
I20260809 18:50:55.208396 9634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.202770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48226 (local address 127.12.202.195:45245)
0809 18:50:55.203226 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:55.203229 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:55.203239 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:50:55.203271 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:55.203272 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:55.203285 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:55.203387 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:55.203739 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.204924 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.206981 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.207739 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.207805 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.207859 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:55.208238 (+ 379us) server_negotiation.cc:299] Negotiation successful
0809 18:50:55.208284 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":125,"threads_started":1}
I20260809 18:50:55.208425 9275 tablet_service.cc:1467] Processing CreateTablet for tablet cd9dd449c7594e1d8872c815d5505602 (DEFAULT_TABLE table=test-table [id=68a3244606414780b522dd46f6b8313f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:50:55.208777 9275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd9dd449c7594e1d8872c815d5505602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:55.208745 9043 tablet_service.cc:1467] Processing CreateTablet for tablet cd9dd449c7594e1d8872c815d5505602 (DEFAULT_TABLE table=test-table [id=68a3244606414780b522dd46f6b8313f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:50:55.209103 9043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd9dd449c7594e1d8872c815d5505602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:55.211480 9639 tablet_bootstrap.cc:492] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042: Bootstrap starting.
I20260809 18:50:55.211877 9640 tablet_bootstrap.cc:492] T cd9dd449c7594e1d8872c815d5505602 P 11232fe2867444ecacd32c228deebcdd: Bootstrap starting.
I20260809 18:50:55.212230 9639 tablet_bootstrap.cc:654] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:55.212386 9492 tablet_service.cc:1467] Processing CreateTablet for tablet cd9dd449c7594e1d8872c815d5505602 (DEFAULT_TABLE table=test-table [id=68a3244606414780b522dd46f6b8313f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:50:55.212666 9640 tablet_bootstrap.cc:654] T cd9dd449c7594e1d8872c815d5505602 P 11232fe2867444ecacd32c228deebcdd: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:55.212744 9492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd9dd449c7594e1d8872c815d5505602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:55.212924 9639 log.cc:824] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:55.213299 9640 log.cc:824] T cd9dd449c7594e1d8872c815d5505602 P 11232fe2867444ecacd32c228deebcdd: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:55.213749 9639 tablet_bootstrap.cc:492] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042: No bootstrap required, opened a new log
I20260809 18:50:55.213845 9639 ts_tablet_manager.cc:1397] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:50:55.214113 9640 tablet_bootstrap.cc:492] T cd9dd449c7594e1d8872c815d5505602 P 11232fe2867444ecacd32c228deebcdd: No bootstrap required, opened a new log
I20260809 18:50:55.214250 9640 ts_tablet_manager.cc:1397] T cd9dd449c7594e1d8872c815d5505602 P 11232fe2867444ecacd32c228deebcdd: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 18:50:55.215865 9647 tablet_bootstrap.cc:492] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5: Bootstrap starting.
I20260809 18:50:55.215926 9639 raft_consensus.cc:348] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429d2e9201774a6aa70ecd52a02a5042" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45577 } } peers { permanent_uuid: "11232fe2867444ecacd32c228deebcdd" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44199 } } peers { permanent_uuid: "3d30871760a544fabd217d405e92adc5" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45245 } }
I20260809 18:50:55.216121 9639 raft_consensus.cc:374] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:55.216195 9639 raft_consensus.cc:729] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429d2e9201774a6aa70ecd52a02a5042, State: Initialized, Role: FOLLOWER
I20260809 18:50:55.216361 9639 consensus_queue.cc:260] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429d2e9201774a6aa70ecd52a02a5042" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45577 } } peers { permanent_uuid: "11232fe2867444ecacd32c228deebcdd" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44199 } } peers { permanent_uuid: "3d30871760a544fabd217d405e92adc5" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45245 } }
I20260809 18:50:55.216373 9640 raft_consensus.cc:348] T cd9dd449c7594e1d8872c815d5505602 P 11232fe2867444ecacd32c228deebcdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429d2e9201774a6aa70ecd52a02a5042" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45577 } } peers { permanent_uuid: "11232fe2867444ecacd32c228deebcdd" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44199 } } peers { permanent_uuid: "3d30871760a544fabd217d405e92adc5" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45245 } }
I20260809 18:50:55.216602 9647 tablet_bootstrap.cc:654] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:55.216593 9640 raft_consensus.cc:374] T cd9dd449c7594e1d8872c815d5505602 P 11232fe2867444ecacd32c228deebcdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:55.216658 9640 raft_consensus.cc:729] T cd9dd449c7594e1d8872c815d5505602 P 11232fe2867444ecacd32c228deebcdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11232fe2867444ecacd32c228deebcdd, State: Initialized, Role: FOLLOWER
I20260809 18:50:55.216686 9639 ts_tablet_manager.cc:1428] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260809 18:50:55.216770 9640 consensus_queue.cc:260] T cd9dd449c7594e1d8872c815d5505602 P 11232fe2867444ecacd32c228deebcdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429d2e9201774a6aa70ecd52a02a5042" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45577 } } peers { permanent_uuid: "11232fe2867444ecacd32c228deebcdd" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44199 } } peers { permanent_uuid: "3d30871760a544fabd217d405e92adc5" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45245 } }
I20260809 18:50:55.216863 9386 heartbeater.cc:503] Master 127.12.202.254:37707 was elected leader, sending a full tablet report...
I20260809 18:50:55.217060 9640 ts_tablet_manager.cc:1428] T cd9dd449c7594e1d8872c815d5505602 P 11232fe2867444ecacd32c228deebcdd: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:50:55.217154 9162 heartbeater.cc:503] Master 127.12.202.254:37707 was elected leader, sending a full tablet report...
I20260809 18:50:55.217221 9647 log.cc:824] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:55.218029 9647 tablet_bootstrap.cc:492] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5: No bootstrap required, opened a new log
I20260809 18:50:55.218104 9647 ts_tablet_manager.cc:1397] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:50:55.219549 9647 raft_consensus.cc:348] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429d2e9201774a6aa70ecd52a02a5042" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45577 } } peers { permanent_uuid: "11232fe2867444ecacd32c228deebcdd" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44199 } } peers { permanent_uuid: "3d30871760a544fabd217d405e92adc5" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45245 } }
I20260809 18:50:55.219676 9647 raft_consensus.cc:374] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:55.219696 9647 raft_consensus.cc:729] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d30871760a544fabd217d405e92adc5, State: Initialized, Role: FOLLOWER
I20260809 18:50:55.219764 9647 consensus_queue.cc:260] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429d2e9201774a6aa70ecd52a02a5042" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45577 } } peers { permanent_uuid: "11232fe2867444ecacd32c228deebcdd" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44199 } } peers { permanent_uuid: "3d30871760a544fabd217d405e92adc5" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45245 } }
I20260809 18:50:55.219975 9647 ts_tablet_manager.cc:1428] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:50:55.220047 9611 heartbeater.cc:503] Master 127.12.202.254:37707 was elected leader, sending a full tablet report...
W20260809 18:50:55.260469 9388 tablet.cc:2369] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:50:55.356204 9164 tablet.cc:2369] T cd9dd449c7594e1d8872c815d5505602 P 11232fe2867444ecacd32c228deebcdd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:50:55.367990 9650 raft_consensus.cc:482] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:50:55.368181 9650 raft_consensus.cc:504] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429d2e9201774a6aa70ecd52a02a5042" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45577 } } peers { permanent_uuid: "11232fe2867444ecacd32c228deebcdd" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44199 } } peers { permanent_uuid: "3d30871760a544fabd217d405e92adc5" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45245 } }
I20260809 18:50:55.368628 9650 leader_election.cc:288] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11232fe2867444ecacd32c228deebcdd (127.12.202.193:44199), 3d30871760a544fabd217d405e92adc5 (127.12.202.195:45245)
I20260809 18:50:55.371672 9636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.368921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:51103 (local address 127.12.202.193:44199)
0809 18:50:55.368989 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:55.368991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:55.369168 (+ 177us) server_negotiation.cc:407] Connection header received
0809 18:50:55.369200 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:55.369202 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:55.369215 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:55.369277 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:55.369481 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.369982 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.370958 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.371296 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.371401 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.371412 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:55.371554 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 18:50:55.371599 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 18:50:55.371675 9657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.368833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:44199 (local address 127.12.202.194:51103)
0809 18:50:55.369070 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:55.369080 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:55.369153 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:55.369292 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:55.369292 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:55.369293 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:55.369407 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:55.369408 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.370066 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.370067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:55.370841 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:55.370843 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.371402 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.371403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:55.371483 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.371486 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:50:55.371529 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 18:50:55.371559 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":46,"thread_start_us":118,"threads_started":1}
I20260809 18:50:55.371691 9389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.368834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:45245 (local address 127.12.202.194:45909)
0809 18:50:55.368937 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:55.368950 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:55.369008 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:55.369184 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:55.369185 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:55.369187 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:55.369269 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:55.369272 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.369987 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.369988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:55.370837 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:55.370839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.371428 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.371429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:55.371506 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.371509 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:50:55.371586 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 18:50:55.371625 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82,"mutex_wait_us":61}
I20260809 18:50:55.371726 9634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.368931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:45909 (local address 127.12.202.195:45245)
0809 18:50:55.368981 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:55.368983 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:55.368997 (+ 14us) server_negotiation.cc:407] Connection header received
0809 18:50:55.369073 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:55.369075 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:55.369087 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:55.369160 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:55.369354 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.369896 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.370935 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.371300 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.371409 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.371418 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:55.371611 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 18:50:55.371650 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:50:55.372061 9087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd9dd449c7594e1d8872c815d5505602" candidate_uuid: "429d2e9201774a6aa70ecd52a02a5042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11232fe2867444ecacd32c228deebcdd" is_pre_election: true
I20260809 18:50:55.372109 9528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd9dd449c7594e1d8872c815d5505602" candidate_uuid: "429d2e9201774a6aa70ecd52a02a5042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d30871760a544fabd217d405e92adc5" is_pre_election: true
I20260809 18:50:55.372223 9087 raft_consensus.cc:2454] T cd9dd449c7594e1d8872c815d5505602 P 11232fe2867444ecacd32c228deebcdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429d2e9201774a6aa70ecd52a02a5042 in term 0.
I20260809 18:50:55.372278 9528 raft_consensus.cc:2454] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429d2e9201774a6aa70ecd52a02a5042 in term 0.
I20260809 18:50:55.372515 9196 leader_election.cc:302] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11232fe2867444ecacd32c228deebcdd, 429d2e9201774a6aa70ecd52a02a5042; no voters:
I20260809 18:50:55.372668 9650 raft_consensus.cc:2781] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:50:55.372745 9650 raft_consensus.cc:482] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:50:55.372779 9650 raft_consensus.cc:3037] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:55.373540 9650 raft_consensus.cc:504] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429d2e9201774a6aa70ecd52a02a5042" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45577 } } peers { permanent_uuid: "11232fe2867444ecacd32c228deebcdd" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44199 } } peers { permanent_uuid: "3d30871760a544fabd217d405e92adc5" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45245 } }
I20260809 18:50:55.373694 9650 leader_election.cc:288] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [CANDIDATE]: Term 1 election: Requested vote from peers 11232fe2867444ecacd32c228deebcdd (127.12.202.193:44199), 3d30871760a544fabd217d405e92adc5 (127.12.202.195:45245)
I20260809 18:50:55.373864 9087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd9dd449c7594e1d8872c815d5505602" candidate_uuid: "429d2e9201774a6aa70ecd52a02a5042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11232fe2867444ecacd32c228deebcdd"
I20260809 18:50:55.373952 9087 raft_consensus.cc:3037] T cd9dd449c7594e1d8872c815d5505602 P 11232fe2867444ecacd32c228deebcdd [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:55.374655 9087 raft_consensus.cc:2454] T cd9dd449c7594e1d8872c815d5505602 P 11232fe2867444ecacd32c228deebcdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429d2e9201774a6aa70ecd52a02a5042 in term 1.
I20260809 18:50:55.374784 9528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd9dd449c7594e1d8872c815d5505602" candidate_uuid: "429d2e9201774a6aa70ecd52a02a5042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d30871760a544fabd217d405e92adc5"
I20260809 18:50:55.374845 9196 leader_election.cc:302] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11232fe2867444ecacd32c228deebcdd, 429d2e9201774a6aa70ecd52a02a5042; no voters:
I20260809 18:50:55.374886 9528 raft_consensus.cc:3037] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:55.374977 9650 raft_consensus.cc:2781] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:50:55.375169 9650 raft_consensus.cc:686] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [term 1 LEADER]: Becoming Leader. State: Replica: 429d2e9201774a6aa70ecd52a02a5042, State: Running, Role: LEADER
I20260809 18:50:55.375269 9650 consensus_queue.cc:237] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429d2e9201774a6aa70ecd52a02a5042" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45577 } } peers { permanent_uuid: "11232fe2867444ecacd32c228deebcdd" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44199 } } peers { permanent_uuid: "3d30871760a544fabd217d405e92adc5" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45245 } }
I20260809 18:50:55.375779 9528 raft_consensus.cc:2454] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429d2e9201774a6aa70ecd52a02a5042 in term 1.
I20260809 18:50:55.376181 8836 catalog_manager.cc:5495] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429d2e9201774a6aa70ecd52a02a5042 (127.12.202.194). New cstate: current_term: 1 leader_uuid: "429d2e9201774a6aa70ecd52a02a5042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429d2e9201774a6aa70ecd52a02a5042" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45577 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11232fe2867444ecacd32c228deebcdd" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d30871760a544fabd217d405e92adc5" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45245 } health_report { overall_health: UNKNOWN } } }
I20260809 18:50:55.387861 9637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.385486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60578 (local address 127.12.202.194:45577)
0809 18:50:55.385543 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:55.385545 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:55.385554 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:50:55.385621 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:55.385622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:55.385640 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:55.385714 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:50:55.385856 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.386308 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.387070 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.387263 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.387336 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.387524 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:50:55.387618 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:50:55.387714 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:55.387734 (+ 20us) server_negotiation.cc:299] Negotiation successful
0809 18:50:55.387754 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 18:50:55.389791 9528 raft_consensus.cc:1261] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5 [term 1 FOLLOWER]: Refusing update from remote peer 429d2e9201774a6aa70ecd52a02a5042: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:50:55.389794 9087 raft_consensus.cc:1261] T cd9dd449c7594e1d8872c815d5505602 P 11232fe2867444ecacd32c228deebcdd [term 1 FOLLOWER]: Refusing update from remote peer 429d2e9201774a6aa70ecd52a02a5042: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:50:55.390232 9650 consensus_queue.cc:1035] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11232fe2867444ecacd32c228deebcdd" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 44199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:50:55.390410 9658 consensus_queue.cc:1035] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d30871760a544fabd217d405e92adc5" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:50:55.393004 9661 mvcc.cc:205] Tried to move back new op lower bound from 7316690761273733120 to 7316690761217634304. Current Snapshot: MvccSnapshot[applied={T|T < 7316690761273733120}]
I20260809 18:50:55.393198 9663 mvcc.cc:205] Tried to move back new op lower bound from 7316690761273733120 to 7316690761217634304. Current Snapshot: MvccSnapshot[applied={T|T < 7316690761273733120 or (T in {7316690761273733120})}]
I20260809 18:50:55.395431 8836 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:50:55.395539 8836 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:50:55.396370 8836 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bb50bc3e0c424be1b2aa251420c56725: Sending DeleteTablet for 3 replicas of tablet cd9dd449c7594e1d8872c815d5505602
I20260809 18:50:55.396732 9492 tablet_service.cc:1514] Processing DeleteTablet for tablet cd9dd449c7594e1d8872c815d5505602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:50:55 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:48226
I20260809 18:50:55.396763 9043 tablet_service.cc:1514] Processing DeleteTablet for tablet cd9dd449c7594e1d8872c815d5505602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:50:55 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:50696
I20260809 18:50:55.397010 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 8943
I20260809 18:50:55.397025 9275 tablet_service.cc:1514] Processing DeleteTablet for tablet cd9dd449c7594e1d8872c815d5505602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:50:55 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:60570
I20260809 18:50:55.397053 9676 tablet_replica.cc:330] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5: stopping tablet replica
I20260809 18:50:55.397512 9676 raft_consensus.cc:2229] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:50:55.397696 9676 raft_consensus.cc:2258] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:50:55.399932 9678 tablet_replica.cc:330] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042: stopping tablet replica
I20260809 18:50:55.400080 9678 raft_consensus.cc:2229] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:50:55.400142 9676 ts_tablet_manager.cc:1905] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:50:55.400266 9678 raft_consensus.cc:2258] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:50:55.400802 9678 ts_tablet_manager.cc:1905] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:50:55.401914 9676 ts_tablet_manager.cc:1918] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:50:55.402067 9676 log.cc:1196] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/cd9dd449c7594e1d8872c815d5505602
I20260809 18:50:55.402432 9676 ts_tablet_manager.cc:1939] T cd9dd449c7594e1d8872c815d5505602 P 3d30871760a544fabd217d405e92adc5: Deleting consensus metadata
I20260809 18:50:55.402900 8817 catalog_manager.cc:4841] TS 3d30871760a544fabd217d405e92adc5 (127.12.202.195:45245): tablet cd9dd449c7594e1d8872c815d5505602 (table test-table [id=68a3244606414780b522dd46f6b8313f]) successfully deleted
I20260809 18:50:55.402979 9678 ts_tablet_manager.cc:1918] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:50:55.403146 9678 log.cc:1196] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/cd9dd449c7594e1d8872c815d5505602
I20260809 18:50:55.403494 9678 ts_tablet_manager.cc:1939] T cd9dd449c7594e1d8872c815d5505602 P 429d2e9201774a6aa70ecd52a02a5042: Deleting consensus metadata
I20260809 18:50:55.403936 8813 catalog_manager.cc:4841] TS 429d2e9201774a6aa70ecd52a02a5042 (127.12.202.194:45577): tablet cd9dd449c7594e1d8872c815d5505602 (table test-table [id=68a3244606414780b522dd46f6b8313f]) successfully deleted
W20260809 18:50:55.411697 8813 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.202.193:44199 (error 108)
I20260809 18:50:55.412104 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 9169
I20260809 18:50:55.412376 9635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.412209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:44199 (local address 127.0.0.1:50712)
0809 18:50:55.412266 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:55.412331 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:44199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260809 18:50:55.423682 8813 catalog_manager.cc:4584] TS 11232fe2867444ecacd32c228deebcdd (127.12.202.193:44199): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cd9dd449c7594e1d8872c815d5505602: Network error: Client connection negotiation failed: client connection to 127.12.202.193:44199: connect: Connection refused (error 111)
I20260809 18:50:55.432135 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 9393
I20260809 18:50:55.446552 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 8789
2026-08-09T18:50:55Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2333 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T18:50:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:50:55Z Disabled control of system clock
I20260809 18:50:55.484673 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:40425
--webserver_interface=127.12.202.254
--webserver_port=0
--builtin_ntp_servers=127.12.202.212:38823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:40425
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 18:50:55.565797 9687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:55.565999 9687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:55.566017 9687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:55.566987 9687 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:50:55.567018 9687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:55.567030 9687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:55.567041 9687 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:50:55.567052 9687 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:50:55.568194 9687 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:40425
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:40425
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:55.568470 9687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:55.568691 9687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:55.573571 9692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:55.573588 9698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:55.573582 9693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:55.573961 9687 server_base.cc:1034] running on GCE node
I20260809 18:50:55.574247 9687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:55.574568 9687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:55.575707 9687 hybrid_clock.cc:648] HybridClock initialized: now 1786301455575697 us; error 31 us; skew 500 ppm
I20260809 18:50:55.576937 9687 webserver.cc:460] Webserver started at http://127.12.202.254:33151/ using document root <none> and password file <none>
I20260809 18:50:55.577170 9687 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:55.577215 9687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:55.577382 9687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:50:55.578413 9687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "1c5263b3631547f3aa03f68a1863a5ed"
format_stamp: "Formatted at 2026-08-09 18:50:55 on dist-test-slave-45dx"
server_key: "729c69f0fbd60776605aea1147796563"
server_key_iv: "e3a023366822b563620b62f4d2419a6e"
server_key_version: "encryptionkey@0"
I20260809 18:50:55.578773 9687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "1c5263b3631547f3aa03f68a1863a5ed"
format_stamp: "Formatted at 2026-08-09 18:50:55 on dist-test-slave-45dx"
server_key: "729c69f0fbd60776605aea1147796563"
server_key_iv: "e3a023366822b563620b62f4d2419a6e"
server_key_version: "encryptionkey@0"
I20260809 18:50:55.580029 9687 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:50:55.580817 9704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:55.581003 9687 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:55.581095 9687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "1c5263b3631547f3aa03f68a1863a5ed"
format_stamp: "Formatted at 2026-08-09 18:50:55 on dist-test-slave-45dx"
server_key: "729c69f0fbd60776605aea1147796563"
server_key_iv: "e3a023366822b563620b62f4d2419a6e"
server_key_version: "encryptionkey@0"
I20260809 18:50:55.581163 9687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:55.589193 9687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:55.589475 9687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:55.589619 9687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:55.593779 9687 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:40425
I20260809 18:50:55.593829 9792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:40425 every 8 connection(s)
I20260809 18:50:55.594127 9687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:50:55.595057 9794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:55.597333 9794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed: Bootstrap starting.
I20260809 18:50:55.597839 9794 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:55.598093 9794 log.cc:824] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:55.598697 9794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed: No bootstrap required, opened a new log
I20260809 18:50:55.599519 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 9687
I20260809 18:50:55.599671 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:50:55.599898 13099 external_mini_cluster.cc:1428] Setting key 58b643dad1fc2d5c4a70c03b6d534f49
I20260809 18:50:55.601264 9794 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c5263b3631547f3aa03f68a1863a5ed" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 40425 } }
I20260809 18:50:55.601434 9794 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:55.601475 9794 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5263b3631547f3aa03f68a1863a5ed, State: Initialized, Role: FOLLOWER
I20260809 18:50:55.601667 9794 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c5263b3631547f3aa03f68a1863a5ed" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 40425 } }
I20260809 18:50:55.601770 9794 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:50:55.601811 9794 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:50:55.601862 9794 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:55.602574 9794 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c5263b3631547f3aa03f68a1863a5ed" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 40425 } }
I20260809 18:50:55.602679 9794 leader_election.cc:302] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c5263b3631547f3aa03f68a1863a5ed; no voters:
I20260809 18:50:55.602837 9794 leader_election.cc:288] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:50:55.602919 9801 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:50:55.603078 9794 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:50:55.603106 9801 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed [term 1 LEADER]: Becoming Leader. State: Replica: 1c5263b3631547f3aa03f68a1863a5ed, State: Running, Role: LEADER
I20260809 18:50:55.603211 9801 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c5263b3631547f3aa03f68a1863a5ed" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 40425 } }
I20260809 18:50:55.603634 9809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c5263b3631547f3aa03f68a1863a5ed. Latest consensus state: current_term: 1 leader_uuid: "1c5263b3631547f3aa03f68a1863a5ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c5263b3631547f3aa03f68a1863a5ed" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 40425 } } }
I20260809 18:50:55.603780 9809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed [sys.catalog]: This master's current role is: LEADER
I20260809 18:50:55.603987 9808 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c5263b3631547f3aa03f68a1863a5ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c5263b3631547f3aa03f68a1863a5ed" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 40425 } } }
I20260809 18:50:55.604128 9808 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed [sys.catalog]: This master's current role is: LEADER
I20260809 18:50:55.604342 9812 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:50:55.604878 9812 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:50:55.606873 9800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.600406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33910 (local address 127.12.202.254:40425)
0809 18:50:55.600612 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:55.600622 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:55.600653 (+ 31us) server_negotiation.cc:407] Connection header received
0809 18:50:55.601213 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:55.601221 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:55.601297 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:55.601458 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:55.601703 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.603407 (+ 1704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.604585 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.605270 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.605413 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.606147 (+ 734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:55.606151 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:55.606151 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:50:55.606382 (+ 231us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:55.606425 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:50:55.606438 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:55.606523 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:55.606609 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 18:50:55.606689 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":96,"threads_started":1}
I20260809 18:50:55.607141 9812 catalog_manager.cc:1347] Generated new cluster ID: 42cdb67ce374463f846f818280f162a3
I20260809 18:50:55.607187 9812 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:50:55.626641 9812 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:50:55.627146 9812 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:50:55.632345 9812 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed: Generated new TSK 0
I20260809 18:50:55.632503 9812 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:50:55.638407 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:40425
--builtin_ntp_servers=127.12.202.212:38823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 18:50:55.738510 9829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:55.738735 9829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:55.738758 9829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:55.739935 9829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:55.739979 9829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:55.740005 9829 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:50:55.741433 9829 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:40425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:55.741712 9829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:55.742062 9829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:55.747344 9837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:55.747395 9829 server_base.cc:1034] running on GCE node
W20260809 18:50:55.747360 9840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:55.747515 9838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:55.747756 9829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:55.748039 9829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:55.749212 9829 hybrid_clock.cc:648] HybridClock initialized: now 1786301455749190 us; error 38 us; skew 500 ppm
I20260809 18:50:55.750494 9829 webserver.cc:460] Webserver started at http://127.12.202.193:34463/ using document root <none> and password file <none>
I20260809 18:50:55.750759 9829 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:55.750805 9829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:55.750957 9829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:50:55.752153 9829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "15bcf622842842d995f541f6fe87f086"
format_stamp: "Formatted at 2026-08-09 18:50:55 on dist-test-slave-45dx"
server_key: "cfaa048f50178099543ad62ec9386cea"
server_key_iv: "36403484496e027772daba9edba46f81"
server_key_version: "encryptionkey@0"
I20260809 18:50:55.752583 9829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "15bcf622842842d995f541f6fe87f086"
format_stamp: "Formatted at 2026-08-09 18:50:55 on dist-test-slave-45dx"
server_key: "cfaa048f50178099543ad62ec9386cea"
server_key_iv: "36403484496e027772daba9edba46f81"
server_key_version: "encryptionkey@0"
I20260809 18:50:55.753942 9829 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:50:55.754750 9850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:55.754944 9829 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:50:55.755053 9829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "15bcf622842842d995f541f6fe87f086"
format_stamp: "Formatted at 2026-08-09 18:50:55 on dist-test-slave-45dx"
server_key: "cfaa048f50178099543ad62ec9386cea"
server_key_iv: "36403484496e027772daba9edba46f81"
server_key_version: "encryptionkey@0"
I20260809 18:50:55.755129 9829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:55.763490 9829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:55.763767 9829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:55.763918 9829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:55.764132 9829 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:50:55.764541 9829 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:50:55.764599 9829 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:55.764640 9829 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:50:55.764667 9829 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:55.770536 9829 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:34643
I20260809 18:50:55.770582 10033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:34643 every 8 connection(s)
I20260809 18:50:55.770893 9829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:50:55.774817 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 9829
I20260809 18:50:55.775192 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:50:55.775446 13099 external_mini_cluster.cc:1428] Setting key e5802ea57a3daab37e10fc04e31246c0
I20260809 18:50:55.775569 9800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.771515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:45615 (local address 127.12.202.254:40425)
0809 18:50:55.771580 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:55.771582 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:55.771823 (+ 241us) server_negotiation.cc:407] Connection header received
0809 18:50:55.772269 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:55.772270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:55.772286 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:55.772396 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:55.773032 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.773504 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.774373 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.774545 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.774591 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.775310 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:55.775312 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:55.775312 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:50:55.775317 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:55.775332 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:50:55.775336 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:55.775388 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:55.775460 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 18:50:55.775487 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 18:50:55.775787 10038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.771517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:40425 (local address 127.12.202.193:45615)
0809 18:50:55.771706 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:55.771737 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:55.772183 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:55.772463 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:55.772466 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:55.772473 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:50:55.772958 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:55.772962 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.773580 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.773580 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:55.774304 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:55.774306 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.774614 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.774615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:55.774716 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.775174 (+ 458us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:50:55.775175 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:50:55.775201 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:50:55.775221 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:50:55.775394 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:50:55.775399 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:50:55.775402 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:50:55.775465 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 18:50:55.775561 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":97,"threads_started":1}
I20260809 18:50:55.776222 10035 heartbeater.cc:347] Connected to a master server at 127.12.202.254:40425
I20260809 18:50:55.776336 10035 heartbeater.cc:464] Registering TS with master...
I20260809 18:50:55.776510 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:40425
--builtin_ntp_servers=127.12.202.212:38823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 18:50:55.776517 10035 heartbeater.cc:511] Master 127.12.202.254:40425 requested a full tablet report, sending...
I20260809 18:50:55.777032 9729 ts_manager.cc:194] Registered new tserver with Master: 15bcf622842842d995f541f6fe87f086 (127.12.202.193:34643)
I20260809 18:50:55.777904 9729 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.202.193:45615
W20260809 18:50:55.858337 10040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:55.858518 10040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:55.858537 10040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:55.859648 10040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:55.859688 10040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:55.859714 10040 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:50:55.861059 10040 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:40425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:55.861231 10040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:55.861460 10040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:50:55.866539 10040 server_base.cc:1034] running on GCE node
W20260809 18:50:55.866514 10052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:55.866497 10054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:55.866506 10051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:55.867077 10040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:55.867327 10040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:55.868495 10040 hybrid_clock.cc:648] HybridClock initialized: now 1786301455868494 us; error 35 us; skew 500 ppm
I20260809 18:50:55.869881 10040 webserver.cc:460] Webserver started at http://127.12.202.194:39015/ using document root <none> and password file <none>
I20260809 18:50:55.870151 10040 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:55.870225 10040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:55.870386 10040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:50:55.871407 10040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "2a94b78a382d4854bf870b3933a34f76"
format_stamp: "Formatted at 2026-08-09 18:50:55 on dist-test-slave-45dx"
server_key: "f8742d34fdf35bb7866e59b055c01eaa"
server_key_iv: "1b200932ab6608dca8de378455a4bd43"
server_key_version: "encryptionkey@0"
I20260809 18:50:55.871764 10040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "2a94b78a382d4854bf870b3933a34f76"
format_stamp: "Formatted at 2026-08-09 18:50:55 on dist-test-slave-45dx"
server_key: "f8742d34fdf35bb7866e59b055c01eaa"
server_key_iv: "1b200932ab6608dca8de378455a4bd43"
server_key_version: "encryptionkey@0"
I20260809 18:50:55.873137 10040 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:50:55.873821 10064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:55.874012 10040 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:50:55.874114 10040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "2a94b78a382d4854bf870b3933a34f76"
format_stamp: "Formatted at 2026-08-09 18:50:55 on dist-test-slave-45dx"
server_key: "f8742d34fdf35bb7866e59b055c01eaa"
server_key_iv: "1b200932ab6608dca8de378455a4bd43"
server_key_version: "encryptionkey@0"
I20260809 18:50:55.874198 10040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:55.905337 10040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:55.905652 10040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:55.905815 10040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:55.906072 10040 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:50:55.906404 10040 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:50:55.906458 10040 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:55.906502 10040 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:50:55.906530 10040 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:55.912295 10040 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:41621
I20260809 18:50:55.912380 10261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:41621 every 8 connection(s)
I20260809 18:50:55.912694 10040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:50:55.917611 9800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.913471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:52867 (local address 127.12.202.254:40425)
0809 18:50:55.913516 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:55.913518 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:55.913771 (+ 253us) server_negotiation.cc:407] Connection header received
0809 18:50:55.914245 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:55.914246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:55.914255 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:55.914313 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:55.914919 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.915386 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.916287 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.916535 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.916585 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.917414 (+ 829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:55.917415 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:55.917415 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:50:55.917419 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:55.917430 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:50:55.917433 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:55.917469 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:55.917536 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 18:50:55.917554 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 18:50:55.917838 10265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:55.913429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:40425 (local address 127.12.202.194:52867)
0809 18:50:55.913623 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:55.913681 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:55.914167 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:55.914365 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:55.914368 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:55.914376 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:50:55.914853 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:55.914857 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.915468 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.915469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:55.916218 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:55.916220 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:55.916606 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:55.916607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:55.916714 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:55.917282 (+ 568us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:50:55.917283 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:50:55.917311 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:50:55.917334 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:50:55.917474 (+ 140us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:50:55.917476 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:50:55.917478 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:50:55.917523 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 18:50:55.917592 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":97,"threads_started":1}
I20260809 18:50:55.918383 10262 heartbeater.cc:347] Connected to a master server at 127.12.202.254:40425
I20260809 18:50:55.918474 10262 heartbeater.cc:464] Registering TS with master...
I20260809 18:50:55.918618 10262 heartbeater.cc:511] Master 127.12.202.254:40425 requested a full tablet report, sending...
I20260809 18:50:55.919003 9729 ts_manager.cc:194] Registered new tserver with Master: 2a94b78a382d4854bf870b3933a34f76 (127.12.202.194:41621)
I20260809 18:50:55.919368 9729 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.202.194:52867
I20260809 18:50:55.922626 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 10040
I20260809 18:50:55.922708 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:50:55.922873 13099 external_mini_cluster.cc:1428] Setting key d25e071ed7d9719dac44739a7fea3480
I20260809 18:50:55.923800 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:40425
--builtin_ntp_servers=127.12.202.212:38823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 18:50:56.006592 10266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:56.006781 10266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:56.006803 10266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:56.007856 10266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:56.007890 10266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:56.007921 10266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:50:56.009202 10266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:40425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:56.009373 10266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:56.009606 10266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:56.014528 10277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:56.014597 10276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:56.014535 10282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:56.014719 10266 server_base.cc:1034] running on GCE node
I20260809 18:50:56.015005 10266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:56.015277 10266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:56.016438 10266 hybrid_clock.cc:648] HybridClock initialized: now 1786301456016427 us; error 40 us; skew 500 ppm
I20260809 18:50:56.017647 10266 webserver.cc:460] Webserver started at http://127.12.202.195:37903/ using document root <none> and password file <none>
I20260809 18:50:56.017886 10266 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:56.017962 10266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:56.018093 10266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:50:56.019132 10266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "0928d0fd62f848c2a53f8650d238f76e"
format_stamp: "Formatted at 2026-08-09 18:50:56 on dist-test-slave-45dx"
server_key: "9cf799385c7a1ce11e1a08556096177d"
server_key_iv: "857198d8210516a4f965a5b964912cab"
server_key_version: "encryptionkey@0"
I20260809 18:50:56.019485 10266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "0928d0fd62f848c2a53f8650d238f76e"
format_stamp: "Formatted at 2026-08-09 18:50:56 on dist-test-slave-45dx"
server_key: "9cf799385c7a1ce11e1a08556096177d"
server_key_iv: "857198d8210516a4f965a5b964912cab"
server_key_version: "encryptionkey@0"
I20260809 18:50:56.020887 10266 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:50:56.021657 10288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:56.021867 10266 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:50:56.021975 10266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "0928d0fd62f848c2a53f8650d238f76e"
format_stamp: "Formatted at 2026-08-09 18:50:56 on dist-test-slave-45dx"
server_key: "9cf799385c7a1ce11e1a08556096177d"
server_key_iv: "857198d8210516a4f965a5b964912cab"
server_key_version: "encryptionkey@0"
I20260809 18:50:56.022059 10266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:56.039916 10266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:56.040256 10266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:56.040485 10266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:56.040758 10266 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:50:56.041116 10266 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:50:56.041170 10266 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:56.041213 10266 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:50:56.041237 10266 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:56.047174 10266 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:46643
I20260809 18:50:56.047222 10477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:46643 every 8 connection(s)
I20260809 18:50:56.047531 10266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:50:56.049252 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 10266
I20260809 18:50:56.049384 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:50:56.049608 13099 external_mini_cluster.cc:1428] Setting key b6ddb312765036cb3430227f4abc3d57
I20260809 18:50:56.053144 9800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:56.048333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:59993 (local address 127.12.202.254:40425)
0809 18:50:56.048422 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:56.048424 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:56.048619 (+ 195us) server_negotiation.cc:407] Connection header received
0809 18:50:56.049153 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:56.049154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:56.049166 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:56.049230 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:56.050165 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.050804 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.051743 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.051955 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.052039 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:56.052891 (+ 852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:56.052892 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:56.052893 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:50:56.052897 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:56.052911 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:50:56.052915 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:56.052963 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:56.053046 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 18:50:56.053070 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 18:50:56.053360 10480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:56.048274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:40425 (local address 127.12.202.195:59993)
0809 18:50:56.048503 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:56.048537 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:56.049049 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:56.049323 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:56.049327 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:56.049337 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:50:56.050073 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:56.050078 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.050900 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.050901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:56.051653 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:56.051655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.052049 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.052050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:56.052189 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:56.052759 (+ 570us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:50:56.052760 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:50:56.052787 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:50:56.052808 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:50:56.052968 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:50:56.052973 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:50:56.052976 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:50:56.053042 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 18:50:56.053134 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":104,"threads_started":1}
I20260809 18:50:56.053807 10478 heartbeater.cc:347] Connected to a master server at 127.12.202.254:40425
I20260809 18:50:56.053884 10478 heartbeater.cc:464] Registering TS with master...
I20260809 18:50:56.054070 10478 heartbeater.cc:511] Master 127.12.202.254:40425 requested a full tablet report, sending...
I20260809 18:50:56.054420 9729 ts_manager.cc:194] Registered new tserver with Master: 0928d0fd62f848c2a53f8650d238f76e (127.12.202.195:46643)
I20260809 18:50:56.054782 9729 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.202.195:59993
I20260809 18:50:56.061581 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:50:56.066052 9800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:56.063038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33916 (local address 127.12.202.254:40425)
0809 18:50:56.063111 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:56.063114 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:56.063237 (+ 123us) server_negotiation.cc:407] Connection header received
0809 18:50:56.063314 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:56.063315 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:56.063326 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:56.063378 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:56.063556 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.064029 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.064832 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.065043 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.065112 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:56.065829 (+ 717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:56.065830 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:56.065830 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:50:56.065835 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:56.065848 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:50:56.065852 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:56.065898 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:56.065951 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 18:50:56.065971 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 18:50:56.067585 9729 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33916:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:50:56.069250 9729 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:50:56.075346 10492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:56.071519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:41621 (local address 127.0.0.1:47210)
0809 18:50:56.072090 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:56.072097 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:56.072137 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:56.072433 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:56.072434 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:56.072436 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:56.072478 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:56.072479 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.073348 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.073349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:56.074176 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:56.074179 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.075055 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.075056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:56.075127 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:56.075140 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 18:50:56.075207 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 18:50:56.075253 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":61,"threads_started":1}
I20260809 18:50:56.075377 10494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:56.071763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47210 (local address 127.12.202.194:41621)
0809 18:50:56.071937 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:56.071940 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:56.072143 (+ 203us) server_negotiation.cc:407] Connection header received
0809 18:50:56.072323 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:56.072326 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:56.072340 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:56.072549 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:56.072619 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.073261 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.074286 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.074960 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.075044 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:56.075122 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:56.075234 (+ 112us) server_negotiation.cc:299] Negotiation successful
0809 18:50:56.075274 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":85,"threads_started":1}
I20260809 18:50:56.075763 10489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:56.071515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:46643 (local address 127.0.0.1:53872)
0809 18:50:56.071861 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:56.071900 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:56.071976 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:56.072174 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:56.072176 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:56.072179 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:56.072236 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:56.072237 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.073510 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.073510 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:56.074648 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:56.074651 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.075533 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.075534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:56.075594 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:56.075597 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:50:56.075645 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 18:50:56.075684 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"mutex_wait_us":9,"thread_start_us":79,"threads_started":1}
I20260809 18:50:56.075769 10493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:56.071687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53872 (local address 127.12.202.195:46643)
0809 18:50:56.071865 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:56.071870 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:56.071956 (+ 86us) server_negotiation.cc:407] Connection header received
0809 18:50:56.072062 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:56.072063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:56.072075 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:56.072166 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:56.072342 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.073414 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.074739 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.075455 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.075525 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:56.075599 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:56.075653 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 18:50:56.075686 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":80,"threads_started":1}
I20260809 18:50:56.076072 10495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:56.071780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44616 (local address 127.12.202.193:34643)
0809 18:50:56.072253 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:56.072257 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:56.072266 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:50:56.072317 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:56.072319 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:56.072333 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:56.072416 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:56.072594 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.073619 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.074842 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.075551 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.075614 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:56.075706 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:56.075941 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 18:50:56.075981 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":87,"threads_started":1}
I20260809 18:50:56.075989 10488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:56.071517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:34643 (local address 127.0.0.1:44616)
0809 18:50:56.071977 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:56.071987 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:56.072025 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:56.072482 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:56.072482 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:56.072484 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:56.072515 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:56.072517 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.073697 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.073698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:56.074757 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:56.074759 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.075741 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.075742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:56.075826 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:56.075830 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:50:56.075899 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 18:50:56.075940 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":3,"thread_start_us":104,"threads_started":1}
I20260809 18:50:56.076501 10146 tablet_service.cc:1467] Processing CreateTablet for tablet 154ae0578e774904862c5a9698308003 (DEFAULT_TABLE table=test-table [id=89867d69b4f44e91ba81785f7b809f84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:50:56.076951 10146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 154ae0578e774904862c5a9698308003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:56.076982 10373 tablet_service.cc:1467] Processing CreateTablet for tablet 154ae0578e774904862c5a9698308003 (DEFAULT_TABLE table=test-table [id=89867d69b4f44e91ba81785f7b809f84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:50:56.077216 9932 tablet_service.cc:1467] Processing CreateTablet for tablet 154ae0578e774904862c5a9698308003 (DEFAULT_TABLE table=test-table [id=89867d69b4f44e91ba81785f7b809f84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:50:56.077317 10373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 154ae0578e774904862c5a9698308003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:56.077545 9932 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 154ae0578e774904862c5a9698308003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:56.080224 10496 tablet_bootstrap.cc:492] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086: Bootstrap starting.
I20260809 18:50:56.080677 10497 tablet_bootstrap.cc:492] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76: Bootstrap starting.
I20260809 18:50:56.081012 10496 tablet_bootstrap.cc:654] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:56.081317 10496 log.cc:824] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:56.081383 10497 tablet_bootstrap.cc:654] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:56.081681 10497 log.cc:824] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:56.082016 10499 tablet_bootstrap.cc:492] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e: Bootstrap starting.
I20260809 18:50:56.082144 10496 tablet_bootstrap.cc:492] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086: No bootstrap required, opened a new log
I20260809 18:50:56.082219 10496 ts_tablet_manager.cc:1397] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:50:56.082508 10497 tablet_bootstrap.cc:492] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76: No bootstrap required, opened a new log
I20260809 18:50:56.082582 10497 ts_tablet_manager.cc:1397] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:50:56.082688 10499 tablet_bootstrap.cc:654] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:56.083037 10499 log.cc:824] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:56.083839 10499 tablet_bootstrap.cc:492] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e: No bootstrap required, opened a new log
I20260809 18:50:56.083940 10499 ts_tablet_manager.cc:1397] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:50:56.084614 10496 raft_consensus.cc:348] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0928d0fd62f848c2a53f8650d238f76e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46643 } } peers { permanent_uuid: "15bcf622842842d995f541f6fe87f086" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34643 } } peers { permanent_uuid: "2a94b78a382d4854bf870b3933a34f76" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 41621 } }
I20260809 18:50:56.084758 10496 raft_consensus.cc:374] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:56.084820 10496 raft_consensus.cc:729] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15bcf622842842d995f541f6fe87f086, State: Initialized, Role: FOLLOWER
I20260809 18:50:56.084995 10496 consensus_queue.cc:260] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0928d0fd62f848c2a53f8650d238f76e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46643 } } peers { permanent_uuid: "15bcf622842842d995f541f6fe87f086" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34643 } } peers { permanent_uuid: "2a94b78a382d4854bf870b3933a34f76" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 41621 } }
I20260809 18:50:56.085299 10496 ts_tablet_manager.cc:1428] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 18:50:56.085317 10035 heartbeater.cc:503] Master 127.12.202.254:40425 was elected leader, sending a full tablet report...
I20260809 18:50:56.085696 10497 raft_consensus.cc:348] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0928d0fd62f848c2a53f8650d238f76e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46643 } } peers { permanent_uuid: "15bcf622842842d995f541f6fe87f086" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34643 } } peers { permanent_uuid: "2a94b78a382d4854bf870b3933a34f76" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 41621 } }
I20260809 18:50:56.085865 10497 raft_consensus.cc:374] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:56.085903 10497 raft_consensus.cc:729] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a94b78a382d4854bf870b3933a34f76, State: Initialized, Role: FOLLOWER
I20260809 18:50:56.086052 10497 consensus_queue.cc:260] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0928d0fd62f848c2a53f8650d238f76e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46643 } } peers { permanent_uuid: "15bcf622842842d995f541f6fe87f086" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34643 } } peers { permanent_uuid: "2a94b78a382d4854bf870b3933a34f76" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 41621 } }
I20260809 18:50:56.086323 10497 ts_tablet_manager.cc:1428] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260809 18:50:56.086520 10262 heartbeater.cc:503] Master 127.12.202.254:40425 was elected leader, sending a full tablet report...
I20260809 18:50:56.086534 10499 raft_consensus.cc:348] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0928d0fd62f848c2a53f8650d238f76e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46643 } } peers { permanent_uuid: "15bcf622842842d995f541f6fe87f086" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34643 } } peers { permanent_uuid: "2a94b78a382d4854bf870b3933a34f76" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 41621 } }
I20260809 18:50:56.086706 10499 raft_consensus.cc:374] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:56.086781 10499 raft_consensus.cc:729] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0928d0fd62f848c2a53f8650d238f76e, State: Initialized, Role: FOLLOWER
I20260809 18:50:56.086915 10499 consensus_queue.cc:260] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0928d0fd62f848c2a53f8650d238f76e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46643 } } peers { permanent_uuid: "15bcf622842842d995f541f6fe87f086" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34643 } } peers { permanent_uuid: "2a94b78a382d4854bf870b3933a34f76" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 41621 } }
I20260809 18:50:56.087170 10499 ts_tablet_manager.cc:1428] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:50:56.087234 10478 heartbeater.cc:503] Master 127.12.202.254:40425 was elected leader, sending a full tablet report...
W20260809 18:50:56.163341 10263 tablet.cc:2369] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:50:56.206552 10504 raft_consensus.cc:482] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:50:56.206737 10504 raft_consensus.cc:504] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0928d0fd62f848c2a53f8650d238f76e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46643 } } peers { permanent_uuid: "15bcf622842842d995f541f6fe87f086" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34643 } } peers { permanent_uuid: "2a94b78a382d4854bf870b3933a34f76" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 41621 } }
I20260809 18:50:56.207158 10504 leader_election.cc:288] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0928d0fd62f848c2a53f8650d238f76e (127.12.202.195:46643), 2a94b78a382d4854bf870b3933a34f76 (127.12.202.194:41621)
I20260809 18:50:56.210026 10038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:56.207373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:41621 (local address 127.12.202.193:36173)
0809 18:50:56.207434 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:56.207446 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:56.207492 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:56.207647 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:56.207648 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:56.207649 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:56.207725 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:56.207726 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.208470 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.208471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:56.209213 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:56.209215 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.209761 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.209762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:56.209839 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:56.209842 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:50:56.209906 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 18:50:56.209948 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 18:50:56.210026 10494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:56.207467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:36173 (local address 127.12.202.194:41621)
0809 18:50:56.207511 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:56.207513 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:56.207523 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:50:56.207554 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:56.207555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:56.207573 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:56.207643 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:56.207803 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.208295 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.209315 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.209675 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.209761 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:56.209771 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:56.209925 (+ 154us) server_negotiation.cc:299] Negotiation successful
0809 18:50:56.209961 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:50:56.210182 10508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:56.207376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:46643 (local address 127.12.202.193:49931)
0809 18:50:56.207575 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:56.207594 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:56.207676 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:56.207827 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:56.207828 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:56.207829 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:56.207939 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:56.207940 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.208632 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.208633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:56.209375 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:56.209376 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.209909 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.209910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:56.209987 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:56.209990 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:50:56.210057 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 18:50:56.210096 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":15,"thread_start_us":107,"threads_started":1}
I20260809 18:50:56.210168 10493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:56.207447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:49931 (local address 127.12.202.195:46643)
0809 18:50:56.207498 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:56.207500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:56.207667 (+ 167us) server_negotiation.cc:407] Connection header received
0809 18:50:56.207745 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:56.207746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:56.207757 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:56.207823 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:56.208014 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.208555 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.209469 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.209819 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.209903 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:56.209911 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:56.210062 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 18:50:56.210099 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:50:56.210476 10184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "154ae0578e774904862c5a9698308003" candidate_uuid: "15bcf622842842d995f541f6fe87f086" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a94b78a382d4854bf870b3933a34f76" is_pre_election: true
I20260809 18:50:56.210646 10184 raft_consensus.cc:2454] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15bcf622842842d995f541f6fe87f086 in term 0.
I20260809 18:50:56.210582 10408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "154ae0578e774904862c5a9698308003" candidate_uuid: "15bcf622842842d995f541f6fe87f086" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0928d0fd62f848c2a53f8650d238f76e" is_pre_election: true
I20260809 18:50:56.210776 10408 raft_consensus.cc:2454] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15bcf622842842d995f541f6fe87f086 in term 0.
I20260809 18:50:56.210912 9851 leader_election.cc:302] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15bcf622842842d995f541f6fe87f086, 2a94b78a382d4854bf870b3933a34f76; no voters:
I20260809 18:50:56.211090 10504 raft_consensus.cc:2781] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:50:56.211155 10504 raft_consensus.cc:482] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:50:56.211179 10504 raft_consensus.cc:3037] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:56.211901 10504 raft_consensus.cc:504] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0928d0fd62f848c2a53f8650d238f76e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46643 } } peers { permanent_uuid: "15bcf622842842d995f541f6fe87f086" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34643 } } peers { permanent_uuid: "2a94b78a382d4854bf870b3933a34f76" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 41621 } }
I20260809 18:50:56.212049 10504 leader_election.cc:288] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [CANDIDATE]: Term 1 election: Requested vote from peers 0928d0fd62f848c2a53f8650d238f76e (127.12.202.195:46643), 2a94b78a382d4854bf870b3933a34f76 (127.12.202.194:41621)
I20260809 18:50:56.212196 10408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "154ae0578e774904862c5a9698308003" candidate_uuid: "15bcf622842842d995f541f6fe87f086" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0928d0fd62f848c2a53f8650d238f76e"
I20260809 18:50:56.212260 10184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "154ae0578e774904862c5a9698308003" candidate_uuid: "15bcf622842842d995f541f6fe87f086" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a94b78a382d4854bf870b3933a34f76"
I20260809 18:50:56.212282 10408 raft_consensus.cc:3037] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:56.212368 10184 raft_consensus.cc:3037] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:56.213066 10408 raft_consensus.cc:2454] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15bcf622842842d995f541f6fe87f086 in term 1.
I20260809 18:50:56.213179 10184 raft_consensus.cc:2454] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15bcf622842842d995f541f6fe87f086 in term 1.
I20260809 18:50:56.213304 9852 leader_election.cc:302] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0928d0fd62f848c2a53f8650d238f76e, 15bcf622842842d995f541f6fe87f086; no voters:
I20260809 18:50:56.213423 10504 raft_consensus.cc:2781] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:50:56.213594 10504 raft_consensus.cc:686] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [term 1 LEADER]: Becoming Leader. State: Replica: 15bcf622842842d995f541f6fe87f086, State: Running, Role: LEADER
I20260809 18:50:56.213706 10504 consensus_queue.cc:237] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0928d0fd62f848c2a53f8650d238f76e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46643 } } peers { permanent_uuid: "15bcf622842842d995f541f6fe87f086" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34643 } } peers { permanent_uuid: "2a94b78a382d4854bf870b3933a34f76" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 41621 } }
I20260809 18:50:56.214591 9729 catalog_manager.cc:5495] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15bcf622842842d995f541f6fe87f086 (127.12.202.193). New cstate: current_term: 1 leader_uuid: "15bcf622842842d995f541f6fe87f086" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0928d0fd62f848c2a53f8650d238f76e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15bcf622842842d995f541f6fe87f086" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 34643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a94b78a382d4854bf870b3933a34f76" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 41621 } health_report { overall_health: UNKNOWN } } }
I20260809 18:50:56.219386 10495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:56.217462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44620 (local address 127.12.202.193:34643)
0809 18:50:56.217514 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:56.217516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:56.217524 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:50:56.217553 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:56.217554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:56.217577 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:56.217633 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:50:56.217728 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.218146 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.218801 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:56.218978 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:56.219026 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:56.219138 (+ 112us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:50:56.219220 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:50:56.219271 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:56.219307 (+ 36us) server_negotiation.cc:299] Negotiation successful
0809 18:50:56.219321 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 18:50:56.221040 10184 raft_consensus.cc:1261] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76 [term 1 FOLLOWER]: Refusing update from remote peer 15bcf622842842d995f541f6fe87f086: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:50:56.221040 10408 raft_consensus.cc:1261] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e [term 1 FOLLOWER]: Refusing update from remote peer 15bcf622842842d995f541f6fe87f086: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:50:56.221369 10510 consensus_queue.cc:1035] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a94b78a382d4854bf870b3933a34f76" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 41621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:50:56.221494 10504 consensus_queue.cc:1035] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0928d0fd62f848c2a53f8650d238f76e" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:50:56.223829 10520 mvcc.cc:205] Tried to move back new op lower bound from 7316690764678975488 to 7316690764651978752. Current Snapshot: MvccSnapshot[applied={T|T < 7316690764678975488}]
I20260809 18:50:56.223858 10522 mvcc.cc:205] Tried to move back new op lower bound from 7316690764678975488 to 7316690764651978752. Current Snapshot: MvccSnapshot[applied={T|T < 7316690764678975488}]
I20260809 18:50:56.224906 10521 mvcc.cc:205] Tried to move back new op lower bound from 7316690764678975488 to 7316690764651978752. Current Snapshot: MvccSnapshot[applied={T|T < 7316690764678975488}]
I20260809 18:50:56.226294 9727 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:50:56.226388 9727 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:50:56.227559 9727 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1c5263b3631547f3aa03f68a1863a5ed: Sending DeleteTablet for 3 replicas of tablet 154ae0578e774904862c5a9698308003
I20260809 18:50:56.228089 9932 tablet_service.cc:1514] Processing DeleteTablet for tablet 154ae0578e774904862c5a9698308003 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:50:56 UTC) from {username='slave'} at 127.0.0.1:44616
I20260809 18:50:56.228338 10146 tablet_service.cc:1514] Processing DeleteTablet for tablet 154ae0578e774904862c5a9698308003 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:50:56 UTC) from {username='slave'} at 127.0.0.1:47210
I20260809 18:50:56.228574 10534 tablet_replica.cc:330] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086: stopping tablet replica
I20260809 18:50:56.228705 10535 tablet_replica.cc:330] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76: stopping tablet replica
I20260809 18:50:56.228722 10534 raft_consensus.cc:2229] T 154ae0578e774904862c5a9698308003 P 15bcf622842842d995f541f6fe87f086 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:50:56.228724 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 9829
I20260809 18:50:56.228845 10535 raft_consensus.cc:2229] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:50:56.228928 10535 raft_consensus.cc:2258] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:50:56.229468 10535 ts_tablet_manager.cc:1905] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:50:56.231189 10535 ts_tablet_manager.cc:1918] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:50:56.231276 10535 log.cc:1196] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/154ae0578e774904862c5a9698308003
I20260809 18:50:56.231586 10535 ts_tablet_manager.cc:1939] T 154ae0578e774904862c5a9698308003 P 2a94b78a382d4854bf870b3933a34f76: Deleting consensus metadata
I20260809 18:50:56.232085 9706 catalog_manager.cc:4841] TS 2a94b78a382d4854bf870b3933a34f76 (127.12.202.194:41621): tablet 154ae0578e774904862c5a9698308003 (table test-table [id=89867d69b4f44e91ba81785f7b809f84]) successfully deleted
I20260809 18:50:56.227948 10373 tablet_service.cc:1514] Processing DeleteTablet for tablet 154ae0578e774904862c5a9698308003 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:50:56 UTC) from {username='slave'} at 127.0.0.1:53872
I20260809 18:50:56.232610 10538 tablet_replica.cc:330] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e: stopping tablet replica
I20260809 18:50:56.232717 10538 raft_consensus.cc:2229] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:50:56.232817 10538 raft_consensus.cc:2258] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:50:56.233230 10538 ts_tablet_manager.cc:1905] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:50:56.235015 10538 ts_tablet_manager.cc:1918] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:50:56.235093 10538 log.cc:1196] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/154ae0578e774904862c5a9698308003
I20260809 18:50:56.235373 10538 ts_tablet_manager.cc:1939] T 154ae0578e774904862c5a9698308003 P 0928d0fd62f848c2a53f8650d238f76e: Deleting consensus metadata
I20260809 18:50:56.236763 9708 catalog_manager.cc:4841] TS 0928d0fd62f848c2a53f8650d238f76e (127.12.202.195:46643): tablet 154ae0578e774904862c5a9698308003 (table test-table [id=89867d69b4f44e91ba81785f7b809f84]) successfully deleted
W20260809 18:50:56.246150 9713 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.202.193:34643 (error 108)
I20260809 18:50:56.246433 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 10040
I20260809 18:50:56.252148 10488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:56.246604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:34643 (local address 127.0.0.1:44624)
0809 18:50:56.252065 (+ 5461us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:56.252116 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:34643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5436}
W20260809 18:50:56.253700 9713 catalog_manager.cc:4584] TS 15bcf622842842d995f541f6fe87f086 (127.12.202.193:34643): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 154ae0578e774904862c5a9698308003: Network error: Client connection negotiation failed: client connection to 127.12.202.193:34643: connect: Connection refused (error 111)
I20260809 18:50:56.260790 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 10266
I20260809 18:50:56.269100 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 9687
2026-08-09T18:50:56Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (816 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:50:56 dist-test-slave-45dx krb5kdc[10547](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:50:56 dist-test-slave-45dx krb5kdc[10547](info): set up 2 sockets
Aug 09 18:50:56 dist-test-slave-45dx krb5kdc[10547](info): commencing operation
krb5kdc: starting...
W20260809 18:50:57.526201 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:50:57 dist-test-slave-45dx krb5kdc[10547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:50:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:50:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:50:57.650985 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:36239
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:36239
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:50:57.731389 10564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:57.731643 10564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:57.731679 10564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:57.732896 10564 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:50:57.732954 10564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:57.732973 10564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:57.732993 10564 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:50:57.733021 10564 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:50:57.734705 10564 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:36239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:36239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:57.734977 10564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:57.735212 10564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:57.740087 10576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:57.740113 10573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:57.740124 10572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:57.740211 10564 server_base.cc:1034] running on GCE node
I20260809 18:50:57.741036 10564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:57.741360 10564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:57.742514 10564 hybrid_clock.cc:648] HybridClock initialized: now 1786301457742490 us; error 40 us; skew 500 ppm
Aug 09 18:50:57 dist-test-slave-45dx krb5kdc[10547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301457, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:50:57.749418 10564 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:50:57.749819 10564 webserver.cc:460] Webserver started at http://127.12.202.254:41425/ using document root <none> and password file <none>
I20260809 18:50:57.750027 10564 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:57.750068 10564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:57.750155 10564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:50:57.751154 10564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "54665d87ba5b4eb08067d17244020084"
format_stamp: "Formatted at 2026-08-09 18:50:57 on dist-test-slave-45dx"
server_key: "d177b62322d7c9502a51259b717227c1"
server_key_iv: "1e818aeae64f6da88340242303b1dd75"
server_key_version: "encryptionkey@0"
I20260809 18:50:57.751458 10564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "54665d87ba5b4eb08067d17244020084"
format_stamp: "Formatted at 2026-08-09 18:50:57 on dist-test-slave-45dx"
server_key: "d177b62322d7c9502a51259b717227c1"
server_key_iv: "1e818aeae64f6da88340242303b1dd75"
server_key_version: "encryptionkey@0"
I20260809 18:50:57.752924 10564 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 18:50:57.753636 10587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:57.753919 10564 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:50:57.754055 10564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "54665d87ba5b4eb08067d17244020084"
format_stamp: "Formatted at 2026-08-09 18:50:57 on dist-test-slave-45dx"
server_key: "d177b62322d7c9502a51259b717227c1"
server_key_iv: "1e818aeae64f6da88340242303b1dd75"
server_key_version: "encryptionkey@0"
I20260809 18:50:57.754151 10564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:57.761076 10564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:57.763665 10564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:57.763852 10564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:57.768072 10564 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:36239
I20260809 18:50:57.768102 10664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:36239 every 8 connection(s)
I20260809 18:50:57.768515 10564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:50:57.769459 10666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:57.771632 10666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084: Bootstrap starting.
I20260809 18:50:57.772142 10666 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:57.772481 10666 log.cc:824] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:57.773144 10666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084: No bootstrap required, opened a new log
I20260809 18:50:57.774708 10666 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54665d87ba5b4eb08067d17244020084" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36239 } }
I20260809 18:50:57.774842 10666 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:57.774863 10666 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54665d87ba5b4eb08067d17244020084, State: Initialized, Role: FOLLOWER
I20260809 18:50:57.774993 10666 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54665d87ba5b4eb08067d17244020084" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36239 } }
I20260809 18:50:57.775077 10666 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:50:57.775100 10666 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:50:57.775128 10666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:57.775615 10666 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54665d87ba5b4eb08067d17244020084" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36239 } }
I20260809 18:50:57.775694 10666 leader_election.cc:302] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54665d87ba5b4eb08067d17244020084; no voters:
I20260809 18:50:57.775810 10666 leader_election.cc:288] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:50:57.775877 10673 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:50:57.776048 10666 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:50:57.776047 10673 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084 [term 1 LEADER]: Becoming Leader. State: Replica: 54665d87ba5b4eb08067d17244020084, State: Running, Role: LEADER
I20260809 18:50:57.776094 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 10564
I20260809 18:50:57.776199 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:50:57.776173 10673 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54665d87ba5b4eb08067d17244020084" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36239 } }
I20260809 18:50:57.776453 13099 external_mini_cluster.cc:1428] Setting key fb5d9c0908fde37a007b0fb15b580deb
I20260809 18:50:57.776683 10675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54665d87ba5b4eb08067d17244020084" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54665d87ba5b4eb08067d17244020084" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36239 } } }
I20260809 18:50:57.776764 10675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084 [sys.catalog]: This master's current role is: LEADER
I20260809 18:50:57.776960 10678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54665d87ba5b4eb08067d17244020084. Latest consensus state: current_term: 1 leader_uuid: "54665d87ba5b4eb08067d17244020084" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54665d87ba5b4eb08067d17244020084" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 36239 } } }
I20260809 18:50:57.777050 10678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084 [sys.catalog]: This master's current role is: LEADER
W20260809 18:50:57.777946 10700 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:50:57.778009 10700 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:50:57.778069 10687 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:50:57.778290 10687 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:50:57.779692 10687 catalog_manager.cc:1347] Generated new cluster ID: 5c2e681ea96f4f29b0fbe4b0fdbc731a
I20260809 18:50:57.779740 10687 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:50:57 dist-test-slave-45dx krb5kdc[10547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:50:57.784453 10687 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:50:57.785203 10687 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:50:57.788821 10696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:57.777138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43836 (local address 127.12.202.254:36239)
0809 18:50:57.777354 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:57.777364 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:57.777542 (+ 178us) server_negotiation.cc:407] Connection header received
0809 18:50:57.777767 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:57.777774 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:57.777833 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:57.777961 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:57.778753 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:57.779920 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:57.781041 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:57.781644 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:57.781756 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:57.784617 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:57.784620 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:57.784620 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:50:57.784631 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:57.787039 (+ 2408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:57.787406 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:57.787408 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:57.787409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:57.787504 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:57.787673 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:57.787674 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:57.787674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:57.787935 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:57.788415 (+ 480us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:57.788478 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 18:50:57.788610 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":62,"threads_started":1}
I20260809 18:50:57.795949 10687 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084: Generated new TSK 0
I20260809 18:50:57.796113 10687 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
I20260809 18:50:57.826713 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36239
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:50:57.914242 10707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:57.914446 10707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:57.914470 10707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:57.915542 10707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:57.915576 10707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:57.915601 10707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:50:57.917054 10707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:57.917264 10707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:57.917440 10707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:57.922569 10714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:57.922590 10712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:57.922557 10717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:57.922864 10707 server_base.cc:1034] running on GCE node
I20260809 18:50:57.923072 10707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:57.923255 10707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:57.924371 10707 hybrid_clock.cc:648] HybridClock initialized: now 1786301457924361 us; error 42 us; skew 500 ppm
Aug 09 18:50:57 dist-test-slave-45dx krb5kdc[10547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301457, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:50:57.926980 10707 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:50:57.927404 10707 webserver.cc:460] Webserver started at http://127.12.202.193:45197/ using document root <none> and password file <none>
I20260809 18:50:57.927641 10707 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:57.927706 10707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:57.927862 10707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:50:57.928951 10707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "c8be4aeb29eb4a2ba8dc05866abe353f"
format_stamp: "Formatted at 2026-08-09 18:50:57 on dist-test-slave-45dx"
server_key: "c71a72d67fbaaee31dc36a2555921655"
server_key_iv: "0e556e922c62364255d602245e4f1cad"
server_key_version: "encryptionkey@0"
I20260809 18:50:57.929306 10707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "c8be4aeb29eb4a2ba8dc05866abe353f"
format_stamp: "Formatted at 2026-08-09 18:50:57 on dist-test-slave-45dx"
server_key: "c71a72d67fbaaee31dc36a2555921655"
server_key_iv: "0e556e922c62364255d602245e4f1cad"
server_key_version: "encryptionkey@0"
I20260809 18:50:57.930668 10707 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:50:57.931500 10731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:57.931733 10707 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:50:57.931874 10707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "c8be4aeb29eb4a2ba8dc05866abe353f"
format_stamp: "Formatted at 2026-08-09 18:50:57 on dist-test-slave-45dx"
server_key: "c71a72d67fbaaee31dc36a2555921655"
server_key_iv: "0e556e922c62364255d602245e4f1cad"
server_key_version: "encryptionkey@0"
I20260809 18:50:57.931959 10707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:57.957921 10707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:57.960172 10707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:57.960353 10707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:57.960605 10707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:50:57.960901 10707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:50:57.960935 10707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:57.960960 10707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:50:57.960987 10707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:57.967137 10707 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:37937
I20260809 18:50:57.967237 10918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:37937 every 8 connection(s)
I20260809 18:50:57.967581 10707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:50:57.972229 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 10707
I20260809 18:50:57.972393 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:50:57.972621 13099 external_mini_cluster.cc:1428] Setting key ed3058fc559084c937e9400f7fb83c7f
Aug 09 18:50:57 dist-test-slave-45dx krb5kdc[10547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301457, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:50:57.978425 10696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:57.968447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:44819 (local address 127.12.202.254:36239)
0809 18:50:57.968507 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:57.968509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:57.968731 (+ 222us) server_negotiation.cc:407] Connection header received
0809 18:50:57.969355 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:57.969357 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:57.969375 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:57.969437 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:57.970447 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:57.970971 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:57.971963 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:57.972189 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:57.972267 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:57.975144 (+ 2877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:57.975146 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:57.975146 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:50:57.975153 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:57.976944 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:57.977357 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:57.977359 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:57.977359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:57.977430 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:57.977679 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:57.977680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:57.977681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:57.977834 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:57.977905 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:57.978174 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 18:50:57.978276 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 18:50:57.978456 10924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:57.968430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36239 (local address 127.12.202.193:44819)
0809 18:50:57.968612 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:57.968648 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:57.969230 (+ 582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:57.969504 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:57.969508 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:57.970132 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:50:57.970336 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:57.970341 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:57.971084 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:57.971085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:57.971867 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:57.971869 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:57.972277 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:57.972278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:57.972451 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:57.973131 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:50:57.973140 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:50:57.975038 (+ 1898us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:50:57.977016 (+ 1978us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:57.977024 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:57.977026 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:57.977284 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:57.977502 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:57.977503 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:57.977503 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:57.977613 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:57.977902 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:50:57.977908 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:50:57.978037 (+ 129us) client_negotiation.cc:769] Sending connection context
0809 18:50:57.978129 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 18:50:57.978276 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":83,"threads_started":1}
I20260809 18:50:57.979054 10920 heartbeater.cc:347] Connected to a master server at 127.12.202.254:36239
I20260809 18:50:57.979178 10920 heartbeater.cc:464] Registering TS with master...
I20260809 18:50:57.979406 10920 heartbeater.cc:511] Master 127.12.202.254:36239 requested a full tablet report, sending...
I20260809 18:50:57.980016 10609 ts_manager.cc:194] Registered new tserver with Master: c8be4aeb29eb4a2ba8dc05866abe353f (127.12.202.193:37937)
I20260809 18:50:57.980774 10609 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:44819
WARNING: no policy specified for kudu/127.12.202.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
I20260809 18:50:58.000701 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36239
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:50:58.082698 10928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:58.082929 10928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:58.082953 10928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:58.084075 10928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:58.084116 10928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:58.084141 10928 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:50:58.085578 10928 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:58.085850 10928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:58.086098 10928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:58.091113 10944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:58.091126 10942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:58.091162 10928 server_base.cc:1034] running on GCE node
W20260809 18:50:58.091143 10941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:58.091555 10928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:58.091815 10928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:58.092975 10928 hybrid_clock.cc:648] HybridClock initialized: now 1786301458092979 us; error 44 us; skew 500 ppm
Aug 09 18:50:58 dist-test-slave-45dx krb5kdc[10547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301458, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:50:58.095703 10928 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:50:58.096154 10928 webserver.cc:460] Webserver started at http://127.12.202.194:46267/ using document root <none> and password file <none>
I20260809 18:50:58.096446 10928 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:58.096519 10928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:58.096668 10928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:50:58.097729 10928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "897e7ad3eed54d29965864a82362d53f"
format_stamp: "Formatted at 2026-08-09 18:50:58 on dist-test-slave-45dx"
server_key: "f949d5ad3422df4b7e5d6cb21ddfc85d"
server_key_iv: "179dfbe015aea7ac7906fbb6518db171"
server_key_version: "encryptionkey@0"
I20260809 18:50:58.098100 10928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "897e7ad3eed54d29965864a82362d53f"
format_stamp: "Formatted at 2026-08-09 18:50:58 on dist-test-slave-45dx"
server_key: "f949d5ad3422df4b7e5d6cb21ddfc85d"
server_key_iv: "179dfbe015aea7ac7906fbb6518db171"
server_key_version: "encryptionkey@0"
I20260809 18:50:58.099423 10928 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:50:58.100148 10955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:58.100365 10928 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:50:58.100476 10928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "897e7ad3eed54d29965864a82362d53f"
format_stamp: "Formatted at 2026-08-09 18:50:58 on dist-test-slave-45dx"
server_key: "f949d5ad3422df4b7e5d6cb21ddfc85d"
server_key_iv: "179dfbe015aea7ac7906fbb6518db171"
server_key_version: "encryptionkey@0"
I20260809 18:50:58.100564 10928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:58.120553 10928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:58.122579 10928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:58.122750 10928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:58.123000 10928 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:50:58.123343 10928 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:50:58.123409 10928 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:58.123451 10928 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:50:58.123479 10928 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:58.129554 10928 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:38071
I20260809 18:50:58.129608 11129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:38071 every 8 connection(s)
I20260809 18:50:58.129963 10928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:50:58.135824 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 10928
I20260809 18:50:58.135960 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:50:58.136193 13099 external_mini_cluster.cc:1428] Setting key d363ff871e08f5615477469837f5e277
Aug 09 18:50:58 dist-test-slave-45dx krb5kdc[10547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301458, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:50:58.139889 10696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.130708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:52925 (local address 127.12.202.254:36239)
0809 18:50:58.130753 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:58.130755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:58.130989 (+ 234us) server_negotiation.cc:407] Connection header received
0809 18:50:58.131529 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:58.131531 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:58.131544 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:58.131608 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:58.132618 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.133111 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.134128 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.134318 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.134408 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.136949 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:58.136951 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:58.136952 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:50:58.136960 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:58.138342 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:58.138825 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:58.138827 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:58.138827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:58.138916 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:58.139227 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:58.139228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:58.139228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:58.139337 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:58.139392 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:58.139723 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 18:50:58.139793 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:50:58.140151 11132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.130672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36239 (local address 127.12.202.194:52925)
0809 18:50:58.130868 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:58.130904 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:58.131423 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:58.131684 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:58.131688 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:58.132271 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:50:58.132521 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:58.132526 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.133216 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.133217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:58.134026 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:58.134028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.134421 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.134422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:58.134539 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.135084 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:50:58.135092 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:50:58.136851 (+ 1759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:50:58.138438 (+ 1587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:58.138447 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:58.138449 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:58.138687 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:58.139002 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:58.139003 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:58.139004 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:58.139154 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:58.139404 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:50:58.139410 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:50:58.139583 (+ 173us) client_negotiation.cc:769] Sending connection context
0809 18:50:58.139704 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 18:50:58.139899 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":90,"threads_started":1}
I20260809 18:50:58.140857 11130 heartbeater.cc:347] Connected to a master server at 127.12.202.254:36239
I20260809 18:50:58.140954 11130 heartbeater.cc:464] Registering TS with master...
I20260809 18:50:58.141150 11130 heartbeater.cc:511] Master 127.12.202.254:36239 requested a full tablet report, sending...
I20260809 18:50:58.141512 10609 ts_manager.cc:194] Registered new tserver with Master: 897e7ad3eed54d29965864a82362d53f (127.12.202.194:38071)
I20260809 18:50:58.141949 10609 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:52925
WARNING: no policy specified for kudu/127.12.202.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
I20260809 18:50:58.162627 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36239
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:50:58.245308 11136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:58.245507 11136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:58.245529 11136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:58.246850 11136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:58.246901 11136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:58.246928 11136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:50:58.248463 11136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:36239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:58.248629 11136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:58.248796 11136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:58.253800 11146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:58.253861 11136 server_base.cc:1034] running on GCE node
W20260809 18:50:58.253808 11149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:58.253808 11147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:58.254199 11136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:58.254452 11136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:58.255614 11136 hybrid_clock.cc:648] HybridClock initialized: now 1786301458255599 us; error 25 us; skew 500 ppm
Aug 09 18:50:58 dist-test-slave-45dx krb5kdc[10547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301458, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:50:58.258196 11136 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:50:58.258672 11136 webserver.cc:460] Webserver started at http://127.12.202.195:38171/ using document root <none> and password file <none>
I20260809 18:50:58.258890 11136 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:58.258955 11136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:58.259106 11136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:50:58.260102 11136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "a23ed896d7ca4adab0ae300a802c52cd"
format_stamp: "Formatted at 2026-08-09 18:50:58 on dist-test-slave-45dx"
server_key: "2e17b53521b4fddb0d2dc4da913ddb3d"
server_key_iv: "64dbec8eef31ad8768a9c3ad1a72376f"
server_key_version: "encryptionkey@0"
I20260809 18:50:58.260510 11136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "a23ed896d7ca4adab0ae300a802c52cd"
format_stamp: "Formatted at 2026-08-09 18:50:58 on dist-test-slave-45dx"
server_key: "2e17b53521b4fddb0d2dc4da913ddb3d"
server_key_iv: "64dbec8eef31ad8768a9c3ad1a72376f"
server_key_version: "encryptionkey@0"
I20260809 18:50:58.264549 11136 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.002s
I20260809 18:50:58.265461 11161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:58.265657 11136 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:50:58.265761 11136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "a23ed896d7ca4adab0ae300a802c52cd"
format_stamp: "Formatted at 2026-08-09 18:50:58 on dist-test-slave-45dx"
server_key: "2e17b53521b4fddb0d2dc4da913ddb3d"
server_key_iv: "64dbec8eef31ad8768a9c3ad1a72376f"
server_key_version: "encryptionkey@0"
I20260809 18:50:58.265841 11136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:58.307451 11136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:58.309544 11136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:58.309718 11136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:58.310007 11136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:50:58.310343 11136 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:50:58.310401 11136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:58.310444 11136 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:50:58.310469 11136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:58.316491 11136 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:36675
I20260809 18:50:58.316537 11353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:36675 every 8 connection(s)
I20260809 18:50:58.316869 11136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:50:58.318033 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 11136
I20260809 18:50:58.318140 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:50:58.318308 13099 external_mini_cluster.cc:1428] Setting key 043d9f1f0b9ed7f12707eef0bb17f117
Aug 09 18:50:58 dist-test-slave-45dx krb5kdc[10547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301458, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:50:58.325975 10696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.317604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:55761 (local address 127.12.202.254:36239)
0809 18:50:58.317684 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:58.317686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:58.317830 (+ 144us) server_negotiation.cc:407] Connection header received
0809 18:50:58.318396 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:58.318398 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:58.318412 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:58.318464 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:58.319584 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.320089 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.321120 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.321317 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.321371 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.323506 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:58.323507 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:58.323507 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:50:58.323514 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:58.324802 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:58.325162 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:58.325163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:58.325164 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:58.325214 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:58.325419 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:58.325419 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:58.325419 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:58.325511 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:58.325565 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:58.325841 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 18:50:58.325910 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 18:50:58.326097 11357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.317557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:36239 (local address 127.12.202.195:55761)
0809 18:50:58.317713 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:58.317750 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:58.318276 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:58.318551 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:58.318556 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:58.319307 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:50:58.319505 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:58.319510 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.320171 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.320172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:58.321048 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:58.321051 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.321391 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.321392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:58.321491 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.322048 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:50:58.322058 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:50:58.323428 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:50:58.324876 (+ 1448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:58.324881 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:58.324883 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:58.325101 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:58.325269 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:50:58.325270 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:50:58.325270 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:50:58.325370 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:50:58.325571 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:50:58.325575 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:50:58.325678 (+ 103us) client_negotiation.cc:769] Sending connection context
0809 18:50:58.325781 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 18:50:58.325904 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":91,"threads_started":1}
I20260809 18:50:58.326555 11354 heartbeater.cc:347] Connected to a master server at 127.12.202.254:36239
I20260809 18:50:58.326635 11354 heartbeater.cc:464] Registering TS with master...
I20260809 18:50:58.326769 11354 heartbeater.cc:511] Master 127.12.202.254:36239 requested a full tablet report, sending...
I20260809 18:50:58.327114 10609 ts_manager.cc:194] Registered new tserver with Master: a23ed896d7ca4adab0ae300a802c52cd (127.12.202.195:36675)
I20260809 18:50:58.327507 10609 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:55761
I20260809 18:50:58.329988 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:50:58.337646 10696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.331346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43852 (local address 127.12.202.254:36239)
0809 18:50:58.331422 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:58.331423 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:58.331517 (+ 94us) server_negotiation.cc:407] Connection header received
0809 18:50:58.331590 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:58.331591 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:58.331600 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:58.331671 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:58.332213 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.332744 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.333460 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.333652 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.333722 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.335010 (+ 1288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:58.335011 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:58.335012 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:50:58.335019 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:58.336362 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:58.336779 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:58.336781 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:58.336781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:58.336841 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:50:58.337086 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:50:58.337088 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:50:58.337088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:50:58.337232 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:58.337365 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:58.337475 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 18:50:58.337538 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 18:50:58.339046 10609 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43852:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:50:58.340624 10609 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:50:58.347404 11370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.342895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:38071 (local address 127.0.0.1:42784)
0809 18:50:58.343318 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:58.343329 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:58.343401 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:58.343706 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:58.343707 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:58.343709 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:58.343755 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:58.343756 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.345068 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.345069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:58.346161 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:58.346164 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.347124 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.347125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:58.347191 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.347195 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:50:58.347239 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 18:50:58.347299 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"mutex_wait_us":90,"thread_start_us":91,"threads_started":1}
I20260809 18:50:58.347425 11377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.343284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46840 (local address 127.12.202.193:37937)
0809 18:50:58.343527 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:58.343531 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:58.343709 (+ 178us) server_negotiation.cc:407] Connection header received
0809 18:50:58.343906 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:58.343909 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:58.343925 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:58.343985 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:58.344188 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.344950 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.346471 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.346983 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.347088 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.347156 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:58.347304 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 18:50:58.347341 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":97,"threads_started":1}
I20260809 18:50:58.347412 11372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.342933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:37937 (local address 127.0.0.1:46840)
0809 18:50:58.343640 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:58.343650 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:58.343774 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:58.344072 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:58.344073 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:58.344074 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:58.344113 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:58.344114 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.345075 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.345076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:58.346372 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:58.346374 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.347090 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.347091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:58.347182 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.347195 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 18:50:58.347276 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 18:50:58.347326 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"mutex_wait_us":41,"thread_start_us":68,"threads_started":1}
I20260809 18:50:58.347786 11371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.342876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:36675 (local address 127.0.0.1:58780)
0809 18:50:58.343163 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:58.343207 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:58.343284 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:58.343572 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:58.343575 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:58.343577 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:58.343645 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:58.343647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.345022 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.345023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:58.346364 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:58.346368 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.347553 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.347554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:58.347625 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.347629 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:50:58.347682 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 18:50:58.347719 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":53,"thread_start_us":75,"threads_started":1}
I20260809 18:50:58.348011 11373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.343016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58780 (local address 127.12.202.195:36675)
0809 18:50:58.343197 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:58.343201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:58.343393 (+ 192us) server_negotiation.cc:407] Connection header received
0809 18:50:58.343441 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:58.343444 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:58.343461 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:58.343543 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:58.343733 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.344911 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.346463 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.347207 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.347296 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.347348 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:58.347894 (+ 546us) server_negotiation.cc:299] Negotiation successful
0809 18:50:58.347937 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":105,"threads_started":1}
I20260809 18:50:58.348172 11376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.343151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42784 (local address 127.12.202.194:38071)
0809 18:50:58.343384 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:58.343389 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:58.343400 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:50:58.343469 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:58.343471 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:58.343488 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:58.343598 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:58.343847 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.344942 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.346259 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.347004 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.347658 (+ 654us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.347721 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:58.347746 (+ 25us) server_negotiation.cc:299] Negotiation successful
0809 18:50:58.347785 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":109,"threads_started":1}
I20260809 18:50:58.348205 10813 tablet_service.cc:1467] Processing CreateTablet for tablet 61b070c9983640799dd5e71b521149b3 (DEFAULT_TABLE table=test-table [id=3c469fe39d684128ad8802c51678a74f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:50:58.348623 10813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61b070c9983640799dd5e71b521149b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:58.348657 11241 tablet_service.cc:1467] Processing CreateTablet for tablet 61b070c9983640799dd5e71b521149b3 (DEFAULT_TABLE table=test-table [id=3c469fe39d684128ad8802c51678a74f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:50:58.348831 11023 tablet_service.cc:1467] Processing CreateTablet for tablet 61b070c9983640799dd5e71b521149b3 (DEFAULT_TABLE table=test-table [id=3c469fe39d684128ad8802c51678a74f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:50:58.349004 11241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61b070c9983640799dd5e71b521149b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:58.349138 11023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61b070c9983640799dd5e71b521149b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:58.351279 11378 tablet_bootstrap.cc:492] T 61b070c9983640799dd5e71b521149b3 P c8be4aeb29eb4a2ba8dc05866abe353f: Bootstrap starting.
I20260809 18:50:58.351917 11378 tablet_bootstrap.cc:654] T 61b070c9983640799dd5e71b521149b3 P c8be4aeb29eb4a2ba8dc05866abe353f: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:58.352406 11381 tablet_bootstrap.cc:492] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd: Bootstrap starting.
I20260809 18:50:58.352685 11378 log.cc:824] T 61b070c9983640799dd5e71b521149b3 P c8be4aeb29eb4a2ba8dc05866abe353f: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:58.353052 11381 tablet_bootstrap.cc:654] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:58.353420 11378 tablet_bootstrap.cc:492] T 61b070c9983640799dd5e71b521149b3 P c8be4aeb29eb4a2ba8dc05866abe353f: No bootstrap required, opened a new log
I20260809 18:50:58.353474 11378 ts_tablet_manager.cc:1397] T 61b070c9983640799dd5e71b521149b3 P c8be4aeb29eb4a2ba8dc05866abe353f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:50:58.353600 11381 log.cc:824] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:58.353925 11380 tablet_bootstrap.cc:492] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f: Bootstrap starting.
I20260809 18:50:58.354516 11380 tablet_bootstrap.cc:654] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:58.354964 11380 log.cc:824] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:58.355186 11378 raft_consensus.cc:348] T 61b070c9983640799dd5e71b521149b3 P c8be4aeb29eb4a2ba8dc05866abe353f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897e7ad3eed54d29965864a82362d53f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 38071 } } peers { permanent_uuid: "a23ed896d7ca4adab0ae300a802c52cd" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36675 } } peers { permanent_uuid: "c8be4aeb29eb4a2ba8dc05866abe353f" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37937 } }
I20260809 18:50:58.355489 11378 raft_consensus.cc:374] T 61b070c9983640799dd5e71b521149b3 P c8be4aeb29eb4a2ba8dc05866abe353f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:58.355538 11378 raft_consensus.cc:729] T 61b070c9983640799dd5e71b521149b3 P c8be4aeb29eb4a2ba8dc05866abe353f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8be4aeb29eb4a2ba8dc05866abe353f, State: Initialized, Role: FOLLOWER
I20260809 18:50:58.355602 11381 tablet_bootstrap.cc:492] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd: No bootstrap required, opened a new log
I20260809 18:50:58.355669 11381 ts_tablet_manager.cc:1397] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 18:50:58.355647 11378 consensus_queue.cc:260] T 61b070c9983640799dd5e71b521149b3 P c8be4aeb29eb4a2ba8dc05866abe353f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897e7ad3eed54d29965864a82362d53f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 38071 } } peers { permanent_uuid: "a23ed896d7ca4adab0ae300a802c52cd" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36675 } } peers { permanent_uuid: "c8be4aeb29eb4a2ba8dc05866abe353f" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37937 } }
I20260809 18:50:58.355947 11378 ts_tablet_manager.cc:1428] T 61b070c9983640799dd5e71b521149b3 P c8be4aeb29eb4a2ba8dc05866abe353f: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 18:50:58.355953 10920 heartbeater.cc:503] Master 127.12.202.254:36239 was elected leader, sending a full tablet report...
I20260809 18:50:58.356674 11380 tablet_bootstrap.cc:492] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f: No bootstrap required, opened a new log
I20260809 18:50:58.356735 11380 ts_tablet_manager.cc:1397] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 18:50:58.357507 11381 raft_consensus.cc:348] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897e7ad3eed54d29965864a82362d53f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 38071 } } peers { permanent_uuid: "a23ed896d7ca4adab0ae300a802c52cd" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36675 } } peers { permanent_uuid: "c8be4aeb29eb4a2ba8dc05866abe353f" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37937 } }
I20260809 18:50:58.357666 11381 raft_consensus.cc:374] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:58.357708 11381 raft_consensus.cc:729] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a23ed896d7ca4adab0ae300a802c52cd, State: Initialized, Role: FOLLOWER
I20260809 18:50:58.357810 11381 consensus_queue.cc:260] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897e7ad3eed54d29965864a82362d53f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 38071 } } peers { permanent_uuid: "a23ed896d7ca4adab0ae300a802c52cd" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36675 } } peers { permanent_uuid: "c8be4aeb29eb4a2ba8dc05866abe353f" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37937 } }
I20260809 18:50:58.358052 11381 ts_tablet_manager.cc:1428] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 18:50:58.358103 11354 heartbeater.cc:503] Master 127.12.202.254:36239 was elected leader, sending a full tablet report...
I20260809 18:50:58.358814 11380 raft_consensus.cc:348] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897e7ad3eed54d29965864a82362d53f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 38071 } } peers { permanent_uuid: "a23ed896d7ca4adab0ae300a802c52cd" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36675 } } peers { permanent_uuid: "c8be4aeb29eb4a2ba8dc05866abe353f" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37937 } }
I20260809 18:50:58.358990 11380 raft_consensus.cc:374] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:58.359022 11380 raft_consensus.cc:729] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897e7ad3eed54d29965864a82362d53f, State: Initialized, Role: FOLLOWER
I20260809 18:50:58.359092 11380 consensus_queue.cc:260] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897e7ad3eed54d29965864a82362d53f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 38071 } } peers { permanent_uuid: "a23ed896d7ca4adab0ae300a802c52cd" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36675 } } peers { permanent_uuid: "c8be4aeb29eb4a2ba8dc05866abe353f" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37937 } }
I20260809 18:50:58.359275 11380 ts_tablet_manager.cc:1428] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:50:58.359341 11130 heartbeater.cc:503] Master 127.12.202.254:36239 was elected leader, sending a full tablet report...
W20260809 18:50:58.380505 11131 tablet.cc:2369] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 18:50:58.468396 10921 tablet.cc:2369] T 61b070c9983640799dd5e71b521149b3 P c8be4aeb29eb4a2ba8dc05866abe353f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:50:58.479610 11388 raft_consensus.cc:482] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:50:58.479723 11388 raft_consensus.cc:504] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897e7ad3eed54d29965864a82362d53f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 38071 } } peers { permanent_uuid: "a23ed896d7ca4adab0ae300a802c52cd" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36675 } } peers { permanent_uuid: "c8be4aeb29eb4a2ba8dc05866abe353f" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37937 } }
I20260809 18:50:58.480086 11388 leader_election.cc:288] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897e7ad3eed54d29965864a82362d53f (127.12.202.194:38071), c8be4aeb29eb4a2ba8dc05866abe353f (127.12.202.193:37937)
I20260809 18:50:58.484057 11377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.480363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:42469 (local address 127.12.202.193:37937)
0809 18:50:58.480411 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:58.480414 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:58.480571 (+ 157us) server_negotiation.cc:407] Connection header received
0809 18:50:58.480647 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:58.480648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:58.480659 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:58.480708 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:58.480943 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.481688 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.483088 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.483691 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.483761 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.483771 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:58.483958 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 18:50:58.484002 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:50:58.484057 11376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.480632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:45369 (local address 127.12.202.194:38071)
0809 18:50:58.480695 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:58.480697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:58.480707 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:50:58.480733 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:58.480735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:58.480744 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:58.480798 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:58.480978 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.481679 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.483076 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.483634 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.483707 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.483717 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:58.483927 (+ 210us) server_negotiation.cc:299] Negotiation successful
0809 18:50:58.483988 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 18:50:58.484069 11395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.480269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:37937 (local address 127.12.202.195:42469)
0809 18:50:58.480488 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:58.480497 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:58.480580 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:58.480763 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:58.480764 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:58.480766 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:58.480856 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:58.480858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.481817 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.481819 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:58.482977 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:58.482980 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.483815 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.483816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:58.483883 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.483886 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:50:58.483940 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 18:50:58.483975 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":29,"thread_start_us":139,"threads_started":1}
I20260809 18:50:58.484270 11357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.480240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:38071 (local address 127.12.202.195:45369)
0809 18:50:58.480322 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:58.480335 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:58.480384 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:58.480813 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:58.480814 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:58.480816 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:58.480890 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:58.480892 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.481784 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.481785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:58.482974 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:58.482977 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.483704 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.483729 (+ 25us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:58.483823 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.483827 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:50:58.484139 (+ 312us) client_negotiation.cc:240] Negotiation successful
0809 18:50:58.484188 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":27}
I20260809 18:50:58.484683 11059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61b070c9983640799dd5e71b521149b3" candidate_uuid: "a23ed896d7ca4adab0ae300a802c52cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897e7ad3eed54d29965864a82362d53f" is_pre_election: true
I20260809 18:50:58.484867 11059 raft_consensus.cc:2454] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a23ed896d7ca4adab0ae300a802c52cd in term 0.
I20260809 18:50:58.484778 10838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61b070c9983640799dd5e71b521149b3" candidate_uuid: "a23ed896d7ca4adab0ae300a802c52cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8be4aeb29eb4a2ba8dc05866abe353f" is_pre_election: true
I20260809 18:50:58.484990 10838 raft_consensus.cc:2454] T 61b070c9983640799dd5e71b521149b3 P c8be4aeb29eb4a2ba8dc05866abe353f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a23ed896d7ca4adab0ae300a802c52cd in term 0.
I20260809 18:50:58.485253 11169 leader_election.cc:302] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a23ed896d7ca4adab0ae300a802c52cd, c8be4aeb29eb4a2ba8dc05866abe353f; no voters:
I20260809 18:50:58.485421 11388 raft_consensus.cc:2781] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:50:58.485517 11388 raft_consensus.cc:482] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:50:58.485553 11388 raft_consensus.cc:3037] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:58.486270 11388 raft_consensus.cc:504] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897e7ad3eed54d29965864a82362d53f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 38071 } } peers { permanent_uuid: "a23ed896d7ca4adab0ae300a802c52cd" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36675 } } peers { permanent_uuid: "c8be4aeb29eb4a2ba8dc05866abe353f" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37937 } }
I20260809 18:50:58.486433 11388 leader_election.cc:288] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [CANDIDATE]: Term 1 election: Requested vote from peers 897e7ad3eed54d29965864a82362d53f (127.12.202.194:38071), c8be4aeb29eb4a2ba8dc05866abe353f (127.12.202.193:37937)
I20260809 18:50:58.486634 10838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61b070c9983640799dd5e71b521149b3" candidate_uuid: "a23ed896d7ca4adab0ae300a802c52cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8be4aeb29eb4a2ba8dc05866abe353f"
I20260809 18:50:58.486634 11059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61b070c9983640799dd5e71b521149b3" candidate_uuid: "a23ed896d7ca4adab0ae300a802c52cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897e7ad3eed54d29965864a82362d53f"
I20260809 18:50:58.486707 11059 raft_consensus.cc:3037] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:58.486707 10838 raft_consensus.cc:3037] T 61b070c9983640799dd5e71b521149b3 P c8be4aeb29eb4a2ba8dc05866abe353f [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:58.487610 11059 raft_consensus.cc:2454] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a23ed896d7ca4adab0ae300a802c52cd in term 1.
I20260809 18:50:58.487610 10838 raft_consensus.cc:2454] T 61b070c9983640799dd5e71b521149b3 P c8be4aeb29eb4a2ba8dc05866abe353f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a23ed896d7ca4adab0ae300a802c52cd in term 1.
I20260809 18:50:58.487800 11169 leader_election.cc:302] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a23ed896d7ca4adab0ae300a802c52cd, c8be4aeb29eb4a2ba8dc05866abe353f; no voters:
I20260809 18:50:58.487888 11388 raft_consensus.cc:2781] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:50:58.488052 11388 raft_consensus.cc:686] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [term 1 LEADER]: Becoming Leader. State: Replica: a23ed896d7ca4adab0ae300a802c52cd, State: Running, Role: LEADER
I20260809 18:50:58.488150 11388 consensus_queue.cc:237] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897e7ad3eed54d29965864a82362d53f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 38071 } } peers { permanent_uuid: "a23ed896d7ca4adab0ae300a802c52cd" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36675 } } peers { permanent_uuid: "c8be4aeb29eb4a2ba8dc05866abe353f" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37937 } }
I20260809 18:50:58.489048 10607 catalog_manager.cc:5495] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd reported cstate change: term changed from 0 to 1, leader changed from <none> to a23ed896d7ca4adab0ae300a802c52cd (127.12.202.195). New cstate: current_term: 1 leader_uuid: "a23ed896d7ca4adab0ae300a802c52cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "897e7ad3eed54d29965864a82362d53f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 38071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a23ed896d7ca4adab0ae300a802c52cd" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 36675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8be4aeb29eb4a2ba8dc05866abe353f" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37937 } health_report { overall_health: UNKNOWN } } }
I20260809 18:50:58.527209 11373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.524945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58796 (local address 127.12.202.195:36675)
0809 18:50:58.525010 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:58.525012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:58.525022 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:50:58.525096 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:58.525097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:58.525117 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:58.525216 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:50:58.525350 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.525779 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.526464 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.526658 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.526730 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.526888 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:50:58.526979 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:50:58.527079 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:58.527124 (+ 45us) server_negotiation.cc:299] Negotiation successful
0809 18:50:58.527134 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 18:50:58.529006 11059 raft_consensus.cc:1261] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f [term 1 FOLLOWER]: Refusing update from remote peer a23ed896d7ca4adab0ae300a802c52cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:50:58.529016 10838 raft_consensus.cc:1261] T 61b070c9983640799dd5e71b521149b3 P c8be4aeb29eb4a2ba8dc05866abe353f [term 1 FOLLOWER]: Refusing update from remote peer a23ed896d7ca4adab0ae300a802c52cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:50:58.529372 11388 consensus_queue.cc:1035] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "897e7ad3eed54d29965864a82362d53f" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 38071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:50:58.529524 11396 consensus_queue.cc:1035] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8be4aeb29eb4a2ba8dc05866abe353f" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 37937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:50:58.534026 10607 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:50:58.534121 10607 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:50:58.534866 10607 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 54665d87ba5b4eb08067d17244020084: Sending DeleteTablet for 3 replicas of tablet 61b070c9983640799dd5e71b521149b3
I20260809 18:50:58.535164 11023 tablet_service.cc:1514] Processing DeleteTablet for tablet 61b070c9983640799dd5e71b521149b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:50:58 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:42784
I20260809 18:50:58.535193 11241 tablet_service.cc:1514] Processing DeleteTablet for tablet 61b070c9983640799dd5e71b521149b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:50:58 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:58780
I20260809 18:50:58.535231 10813 tablet_service.cc:1514] Processing DeleteTablet for tablet 61b070c9983640799dd5e71b521149b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:50:58 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:46840
I20260809 18:50:58.535408 11414 tablet_replica.cc:330] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd: stopping tablet replica
I20260809 18:50:58.535502 11417 tablet_replica.cc:330] T 61b070c9983640799dd5e71b521149b3 P c8be4aeb29eb4a2ba8dc05866abe353f: stopping tablet replica
I20260809 18:50:58.535521 11414 raft_consensus.cc:2229] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:50:58.535643 11414 raft_consensus.cc:2258] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:50:58.535645 11417 raft_consensus.cc:2229] T 61b070c9983640799dd5e71b521149b3 P c8be4aeb29eb4a2ba8dc05866abe353f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:50:58.535753 11417 raft_consensus.cc:2258] T 61b070c9983640799dd5e71b521149b3 P c8be4aeb29eb4a2ba8dc05866abe353f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:50:58.535897 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 10707
I20260809 18:50:58.542827 11415 tablet_replica.cc:330] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f: stopping tablet replica
I20260809 18:50:58.542956 11415 raft_consensus.cc:2229] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:50:58.543053 11415 raft_consensus.cc:2258] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:50:58.543783 11415 ts_tablet_manager.cc:1905] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:50:58.544562 11414 ts_tablet_manager.cc:1905] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:50:58.545447 11415 ts_tablet_manager.cc:1918] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:50:58.545531 11415 log.cc:1196] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/61b070c9983640799dd5e71b521149b3
I20260809 18:50:58.545811 11415 ts_tablet_manager.cc:1939] T 61b070c9983640799dd5e71b521149b3 P 897e7ad3eed54d29965864a82362d53f: Deleting consensus metadata
I20260809 18:50:58.546339 11414 ts_tablet_manager.cc:1918] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:50:58.546325 10590 catalog_manager.cc:4841] TS 897e7ad3eed54d29965864a82362d53f (127.12.202.194:38071): tablet 61b070c9983640799dd5e71b521149b3 (table test-table [id=3c469fe39d684128ad8802c51678a74f]) successfully deleted
I20260809 18:50:58.546479 11414 log.cc:1196] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/61b070c9983640799dd5e71b521149b3
I20260809 18:50:58.546741 11414 ts_tablet_manager.cc:1939] T 61b070c9983640799dd5e71b521149b3 P a23ed896d7ca4adab0ae300a802c52cd: Deleting consensus metadata
I20260809 18:50:58.547107 10588 catalog_manager.cc:4841] TS a23ed896d7ca4adab0ae300a802c52cd (127.12.202.195:36675): tablet 61b070c9983640799dd5e71b521149b3 (table test-table [id=3c469fe39d684128ad8802c51678a74f]) successfully deleted
W20260809 18:50:58.548445 10591 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.202.193:37937 (error 108)
I20260809 18:50:58.548918 11372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.548791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:37937 (local address 127.0.0.1:46842)
0809 18:50:58.548846 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:58.548883 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:37937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 18:50:58.549029 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 10928
W20260809 18:50:58.549055 10591 catalog_manager.cc:4584] TS c8be4aeb29eb4a2ba8dc05866abe353f (127.12.202.193:37937): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 61b070c9983640799dd5e71b521149b3: Network error: Client connection negotiation failed: client connection to 127.12.202.193:37937: connect: Connection refused (error 111)
I20260809 18:50:58.560626 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 11136
I20260809 18:50:58.573534 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 10564
2026-08-09T18:50:58Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2305 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T18:50:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:50:58Z Disabled control of system clock
I20260809 18:50:58.605635 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:42541
--webserver_interface=127.12.202.254
--webserver_port=0
--builtin_ntp_servers=127.12.202.212:45415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:42541
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 18:50:58.685196 11423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:58.685416 11423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:58.685436 11423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:58.686532 11423 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:50:58.686563 11423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:58.686575 11423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:58.686587 11423 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:50:58.686599 11423 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:50:58.687849 11423 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:45415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:42541
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:42541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11423
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:58.688046 11423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:58.688280 11423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:58.693437 11431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:58.693475 11423 server_base.cc:1034] running on GCE node
W20260809 18:50:58.693437 11432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:58.693465 11435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:58.694010 11423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:58.694310 11423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:58.695497 11423 hybrid_clock.cc:648] HybridClock initialized: now 1786301458695476 us; error 41 us; skew 500 ppm
I20260809 18:50:58.697049 11423 webserver.cc:460] Webserver started at http://127.12.202.254:39229/ using document root <none> and password file <none>
I20260809 18:50:58.697324 11423 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:58.697372 11423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:58.697557 11423 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:50:58.698702 11423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "6937dec089db47739931d0bb6bf56a1d"
format_stamp: "Formatted at 2026-08-09 18:50:58 on dist-test-slave-45dx"
server_key: "20de9abf6c5a6ab06e7589b62a4b3094"
server_key_iv: "af6de1b5364787766a241ee6f66a23e0"
server_key_version: "encryptionkey@0"
I20260809 18:50:58.699088 11423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "6937dec089db47739931d0bb6bf56a1d"
format_stamp: "Formatted at 2026-08-09 18:50:58 on dist-test-slave-45dx"
server_key: "20de9abf6c5a6ab06e7589b62a4b3094"
server_key_iv: "af6de1b5364787766a241ee6f66a23e0"
server_key_version: "encryptionkey@0"
I20260809 18:50:58.700479 11423 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:50:58.701218 11445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:58.701399 11423 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:50:58.701496 11423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "6937dec089db47739931d0bb6bf56a1d"
format_stamp: "Formatted at 2026-08-09 18:50:58 on dist-test-slave-45dx"
server_key: "20de9abf6c5a6ab06e7589b62a4b3094"
server_key_iv: "af6de1b5364787766a241ee6f66a23e0"
server_key_version: "encryptionkey@0"
I20260809 18:50:58.701577 11423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:58.724457 11423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:58.724774 11423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:58.724946 11423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:58.728840 11423 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:42541
I20260809 18:50:58.728914 11533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:42541 every 8 connection(s)
I20260809 18:50:58.729255 11423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:50:58.730039 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 11423
I20260809 18:50:58.730163 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:50:58.730413 13099 external_mini_cluster.cc:1428] Setting key 0af4b0954670409a445fa39c00611abe
I20260809 18:50:58.730479 11534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:58.733210 11534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d: Bootstrap starting.
I20260809 18:50:58.733769 11534 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:58.734078 11534 log.cc:824] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:58.734759 11534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d: No bootstrap required, opened a new log
I20260809 18:50:58.735908 11540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.730998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50584 (local address 127.12.202.254:42541)
0809 18:50:58.731219 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:58.731225 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:58.731249 (+ 24us) server_negotiation.cc:407] Connection header received
0809 18:50:58.731829 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:58.731836 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:58.731896 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:58.732041 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:58.732271 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.733104 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.733910 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.734365 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.734495 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.735250 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:58.735254 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:58.735254 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:50:58.735470 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:58.735502 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:50:58.735513 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:58.735591 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:58.735666 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 18:50:58.735742 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":93,"threads_started":1}
I20260809 18:50:58.736909 11534 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6937dec089db47739931d0bb6bf56a1d" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42541 } }
I20260809 18:50:58.737067 11534 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:58.737112 11534 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6937dec089db47739931d0bb6bf56a1d, State: Initialized, Role: FOLLOWER
I20260809 18:50:58.737249 11534 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6937dec089db47739931d0bb6bf56a1d" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42541 } }
I20260809 18:50:58.737339 11534 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:50:58.737382 11534 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:50:58.737429 11534 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:58.737926 11534 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6937dec089db47739931d0bb6bf56a1d" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42541 } }
I20260809 18:50:58.738046 11534 leader_election.cc:302] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6937dec089db47739931d0bb6bf56a1d; no voters:
I20260809 18:50:58.738229 11534 leader_election.cc:288] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:50:58.738260 11543 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:50:58.738423 11543 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d [term 1 LEADER]: Becoming Leader. State: Replica: 6937dec089db47739931d0bb6bf56a1d, State: Running, Role: LEADER
I20260809 18:50:58.738489 11534 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:50:58.738504 11543 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6937dec089db47739931d0bb6bf56a1d" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42541 } }
I20260809 18:50:58.738936 11544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6937dec089db47739931d0bb6bf56a1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6937dec089db47739931d0bb6bf56a1d" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42541 } } }
I20260809 18:50:58.738955 11546 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6937dec089db47739931d0bb6bf56a1d. Latest consensus state: current_term: 1 leader_uuid: "6937dec089db47739931d0bb6bf56a1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6937dec089db47739931d0bb6bf56a1d" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42541 } } }
I20260809 18:50:58.739061 11544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d [sys.catalog]: This master's current role is: LEADER
I20260809 18:50:58.739069 11546 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d [sys.catalog]: This master's current role is: LEADER
W20260809 18:50:58.740242 11567 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:50:58.740331 11567 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:50:58.740422 11558 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:50:58.740571 11558 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:50:58.741973 11558 catalog_manager.cc:1347] Generated new cluster ID: e23bb09e747746d6a1eeb2d5e5a013b5
I20260809 18:50:58.742023 11558 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:50:58.763125 11558 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:50:58.763885 11558 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:50:58.769807 11558 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d: Generated new TSK 0
I20260809 18:50:58.770015 11558 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:50:58.771955 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42541
--builtin_ntp_servers=127.12.202.212:45415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 18:50:58.852998 11572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:58.853235 11572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:58.853272 11572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:58.854377 11572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:58.854442 11572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:58.854483 11572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:50:58.855794 11572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:45415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:58.856035 11572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:58.856352 11572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:58.862241 11578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:58.862205 11577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:58.862444 11572 server_base.cc:1034] running on GCE node
W20260809 18:50:58.862610 11582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:58.862830 11572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:58.863106 11572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:58.864285 11572 hybrid_clock.cc:648] HybridClock initialized: now 1786301458864272 us; error 27 us; skew 500 ppm
I20260809 18:50:58.865701 11572 webserver.cc:460] Webserver started at http://127.12.202.193:34759/ using document root <none> and password file <none>
I20260809 18:50:58.865942 11572 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:58.866000 11572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:58.866132 11572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:50:58.867460 11572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "ddfdae5aae49403bbf03494292a21661"
format_stamp: "Formatted at 2026-08-09 18:50:58 on dist-test-slave-45dx"
server_key: "442ccb84726d4385aeb69f65b20d471f"
server_key_iv: "c97b8bdea25c03ac6f1bf04395cf1851"
server_key_version: "encryptionkey@0"
I20260809 18:50:58.867841 11572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "ddfdae5aae49403bbf03494292a21661"
format_stamp: "Formatted at 2026-08-09 18:50:58 on dist-test-slave-45dx"
server_key: "442ccb84726d4385aeb69f65b20d471f"
server_key_iv: "c97b8bdea25c03ac6f1bf04395cf1851"
server_key_version: "encryptionkey@0"
I20260809 18:50:58.869128 11572 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:50:58.869768 11590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:58.869956 11572 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:50:58.870047 11572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "ddfdae5aae49403bbf03494292a21661"
format_stamp: "Formatted at 2026-08-09 18:50:58 on dist-test-slave-45dx"
server_key: "442ccb84726d4385aeb69f65b20d471f"
server_key_iv: "c97b8bdea25c03ac6f1bf04395cf1851"
server_key_version: "encryptionkey@0"
I20260809 18:50:58.870116 11572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:58.888720 11572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:58.889009 11572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:58.889179 11572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:58.889415 11572 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:50:58.889794 11572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:50:58.889854 11572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:58.889899 11572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:50:58.889926 11572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:58.895398 11572 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:36301
I20260809 18:50:58.895501 11782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:36301 every 8 connection(s)
I20260809 18:50:58.895789 11572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:50:58.897600 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 11572
I20260809 18:50:58.897729 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:50:58.897912 13099 external_mini_cluster.cc:1428] Setting key 6e06e1ae584769af849cb54f98276d35
I20260809 18:50:58.898877 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42541
--builtin_ntp_servers=127.12.202.212:45415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 18:50:58.901400 11540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.896596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:36745 (local address 127.12.202.254:42541)
0809 18:50:58.896658 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:58.896660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:58.896912 (+ 252us) server_negotiation.cc:407] Connection header received
0809 18:50:58.897437 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:58.897438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:58.897456 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:58.897500 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:58.898310 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.898928 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.899927 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.900128 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.900214 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.901102 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:58.901103 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:58.901103 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:50:58.901120 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:58.901134 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:50:58.901138 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:58.901206 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:58.901286 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 18:50:58.901324 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 18:50:58.901633 11786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:58.896578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42541 (local address 127.12.202.193:36745)
0809 18:50:58.896775 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:58.896808 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:58.897335 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:58.897576 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:58.897579 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:58.897587 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:50:58.898206 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:58.898213 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.899025 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.899026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:58.899790 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:58.899792 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:58.900228 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:58.900229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:58.900403 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:58.900953 (+ 550us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:50:58.900954 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:50:58.900980 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:50:58.901001 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:50:58.901207 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:50:58.901213 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:50:58.901217 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:50:58.901286 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 18:50:58.901381 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":92,"threads_started":1}
I20260809 18:50:58.902117 11784 heartbeater.cc:347] Connected to a master server at 127.12.202.254:42541
I20260809 18:50:58.902218 11784 heartbeater.cc:464] Registering TS with master...
I20260809 18:50:58.902391 11784 heartbeater.cc:511] Master 127.12.202.254:42541 requested a full tablet report, sending...
I20260809 18:50:58.902933 11473 ts_manager.cc:194] Registered new tserver with Master: ddfdae5aae49403bbf03494292a21661 (127.12.202.193:36301)
I20260809 18:50:58.903617 11473 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.202.193:36745
W20260809 18:50:58.980568 11787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:58.980772 11787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:58.980794 11787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:58.981974 11787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:58.982015 11787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:58.982040 11787 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:50:58.983332 11787 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:45415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:58.983539 11787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:58.983789 11787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:58.988991 11798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:58.988998 11793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:58.989099 11794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:58.989251 11787 server_base.cc:1034] running on GCE node
I20260809 18:50:58.989464 11787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:58.989759 11787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:58.990947 11787 hybrid_clock.cc:648] HybridClock initialized: now 1786301458990938 us; error 37 us; skew 500 ppm
I20260809 18:50:58.992235 11787 webserver.cc:460] Webserver started at http://127.12.202.194:45291/ using document root <none> and password file <none>
I20260809 18:50:58.992558 11787 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:58.992632 11787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:58.992799 11787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:50:58.993882 11787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "e0573de86ff7471a8ce7045fa358dba3"
format_stamp: "Formatted at 2026-08-09 18:50:58 on dist-test-slave-45dx"
server_key: "c7213e7f7f2cd23ffe485c015fa8a3eb"
server_key_iv: "602339d1e9d24ffce8f4ded6d6a0f64b"
server_key_version: "encryptionkey@0"
I20260809 18:50:58.994278 11787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "e0573de86ff7471a8ce7045fa358dba3"
format_stamp: "Formatted at 2026-08-09 18:50:58 on dist-test-slave-45dx"
server_key: "c7213e7f7f2cd23ffe485c015fa8a3eb"
server_key_iv: "602339d1e9d24ffce8f4ded6d6a0f64b"
server_key_version: "encryptionkey@0"
I20260809 18:50:58.995643 11787 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:50:58.996449 11810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:58.996639 11787 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:50:58.996744 11787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "e0573de86ff7471a8ce7045fa358dba3"
format_stamp: "Formatted at 2026-08-09 18:50:58 on dist-test-slave-45dx"
server_key: "c7213e7f7f2cd23ffe485c015fa8a3eb"
server_key_iv: "602339d1e9d24ffce8f4ded6d6a0f64b"
server_key_version: "encryptionkey@0"
I20260809 18:50:58.996832 11787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:59.019721 11787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:59.020045 11787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:59.020203 11787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:59.020475 11787 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:50:59.020810 11787 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:50:59.020866 11787 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:59.020908 11787 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:50:59.020936 11787 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:59.026762 11787 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:45805
I20260809 18:50:59.026820 11988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:45805 every 8 connection(s)
I20260809 18:50:59.027124 11787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:50:59.032423 11540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:59.027839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:47483 (local address 127.12.202.254:42541)
0809 18:50:59.027909 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:59.027912 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:59.028110 (+ 198us) server_negotiation.cc:407] Connection header received
0809 18:50:59.028688 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:59.028690 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:59.028704 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:59.028763 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:59.029443 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.029950 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.030929 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.031140 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.031219 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:59.032103 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:59.032104 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:59.032105 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:50:59.032110 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:59.032126 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:50:59.032130 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:59.032181 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:59.032281 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 18:50:59.032342 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:50:59.032632 11991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:59.027812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42541 (local address 127.12.202.194:47483)
0809 18:50:59.027987 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:59.028020 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:59.028580 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:59.028845 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:59.028848 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:59.028856 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:50:59.029339 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:59.029343 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.030053 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.030055 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:59.030830 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:59.030832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.031227 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.031228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:59.031361 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:59.031947 (+ 586us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:50:59.031948 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:50:59.031976 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:50:59.031999 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:50:59.032187 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:50:59.032191 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:50:59.032194 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:50:59.032281 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 18:50:59.032406 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":73,"threads_started":1}
I20260809 18:50:59.033152 11989 heartbeater.cc:347] Connected to a master server at 127.12.202.254:42541
I20260809 18:50:59.033260 11989 heartbeater.cc:464] Registering TS with master...
I20260809 18:50:59.033438 11989 heartbeater.cc:511] Master 127.12.202.254:42541 requested a full tablet report, sending...
I20260809 18:50:59.033835 11473 ts_manager.cc:194] Registered new tserver with Master: e0573de86ff7471a8ce7045fa358dba3 (127.12.202.194:45805)
I20260809 18:50:59.034170 11473 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.202.194:47483
I20260809 18:50:59.035245 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 11787
I20260809 18:50:59.035386 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:50:59.035595 13099 external_mini_cluster.cc:1428] Setting key ed0b14555506f815d462762b758289c1
I20260809 18:50:59.036567 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42541
--builtin_ntp_servers=127.12.202.212:45415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 18:50:59.120609 11992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:50:59.120807 11992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:50:59.120829 11992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:50:59.122008 11992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:50:59.122051 11992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:50:59.122076 11992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:50:59.123517 11992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:45415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11992
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:50:59.123785 11992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:50:59.124117 11992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:50:59.129146 12001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:59.129194 12003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:50:59.129176 12000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:50:59.129247 11992 server_base.cc:1034] running on GCE node
I20260809 18:50:59.129479 11992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:50:59.129674 11992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:50:59.130857 11992 hybrid_clock.cc:648] HybridClock initialized: now 1786301459130834 us; error 38 us; skew 500 ppm
I20260809 18:50:59.132217 11992 webserver.cc:460] Webserver started at http://127.12.202.195:35355/ using document root <none> and password file <none>
I20260809 18:50:59.132529 11992 fs_manager.cc:359] Metadata directory not provided
I20260809 18:50:59.132591 11992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:50:59.132761 11992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:50:59.133806 11992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "8ebf38ae057c4ccfb0ec1da2fbf149b6"
format_stamp: "Formatted at 2026-08-09 18:50:59 on dist-test-slave-45dx"
server_key: "af096823c51ff038ae1dc21516d32a36"
server_key_iv: "cbf61a67d8c75f484b7f2a646551565f"
server_key_version: "encryptionkey@0"
I20260809 18:50:59.134155 11992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "8ebf38ae057c4ccfb0ec1da2fbf149b6"
format_stamp: "Formatted at 2026-08-09 18:50:59 on dist-test-slave-45dx"
server_key: "af096823c51ff038ae1dc21516d32a36"
server_key_iv: "cbf61a67d8c75f484b7f2a646551565f"
server_key_version: "encryptionkey@0"
I20260809 18:50:59.135437 11992 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:50:59.136173 12014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:59.136404 11992 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:50:59.136499 11992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "8ebf38ae057c4ccfb0ec1da2fbf149b6"
format_stamp: "Formatted at 2026-08-09 18:50:59 on dist-test-slave-45dx"
server_key: "af096823c51ff038ae1dc21516d32a36"
server_key_iv: "cbf61a67d8c75f484b7f2a646551565f"
server_key_version: "encryptionkey@0"
I20260809 18:50:59.136577 11992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:50:59.149605 11992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:50:59.149904 11992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:50:59.150079 11992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:50:59.150301 11992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:50:59.150640 11992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:50:59.150697 11992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:59.150733 11992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:50:59.150759 11992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:50:59.156778 11992 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:39637
I20260809 18:50:59.156840 12197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:39637 every 8 connection(s)
I20260809 18:50:59.157181 11992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:50:59.162643 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 11992
I20260809 18:50:59.162770 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:50:59.162848 12202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:59.157907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42541 (local address 127.12.202.195:48449)
0809 18:50:59.158091 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:59.158152 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:59.158689 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:59.158969 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:59.158973 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:59.158980 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:50:59.159474 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:59.159478 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.160202 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.160203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:59.161004 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:59.161006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.161423 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.161424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:59.161550 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:59.162129 (+ 579us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:50:59.162130 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:50:59.162159 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:50:59.162200 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:50:59.162378 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:50:59.162383 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:50:59.162386 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:50:59.162477 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 18:50:59.162595 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":89,"threads_started":1}
I20260809 18:50:59.163025 13099 external_mini_cluster.cc:1428] Setting key 85234209ef35da128437e83f3cf9001c
I20260809 18:50:59.163151 11540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:59.157919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:48449 (local address 127.12.202.254:42541)
0809 18:50:59.157986 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:59.157988 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:59.158252 (+ 264us) server_negotiation.cc:407] Connection header received
0809 18:50:59.158803 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:59.158804 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:59.158819 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:59.158891 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:59.159577 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.160091 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.161122 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.161328 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.161405 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:59.162296 (+ 891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:59.162298 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:59.162298 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:50:59.162304 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:59.162322 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:50:59.162326 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:59.162379 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:59.163044 (+ 665us) server_negotiation.cc:299] Negotiation successful
0809 18:50:59.163075 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 18:50:59.163558 12198 heartbeater.cc:347] Connected to a master server at 127.12.202.254:42541
I20260809 18:50:59.163656 12198 heartbeater.cc:464] Registering TS with master...
I20260809 18:50:59.163847 12198 heartbeater.cc:511] Master 127.12.202.254:42541 requested a full tablet report, sending...
I20260809 18:50:59.164274 11470 ts_manager.cc:194] Registered new tserver with Master: 8ebf38ae057c4ccfb0ec1da2fbf149b6 (127.12.202.195:39637)
I20260809 18:50:59.164666 11470 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.202.195:48449
I20260809 18:50:59.174791 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:50:59.179224 11540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:59.176199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50596 (local address 127.12.202.254:42541)
0809 18:50:59.176272 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:59.176274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:59.176412 (+ 138us) server_negotiation.cc:407] Connection header received
0809 18:50:59.176477 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:59.176478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:59.176490 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:59.176559 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:50:59.176733 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.177184 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.177932 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.178118 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.178193 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:59.178876 (+ 683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:50:59.178878 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:50:59.178878 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:50:59.178883 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:50:59.178898 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:50:59.178902 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:50:59.179030 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:59.179127 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 18:50:59.179138 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 18:50:59.181147 11470 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50596:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:50:59.182812 11470 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:50:59.189141 12213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:59.184961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:45805 (local address 127.0.0.1:48174)
0809 18:50:59.185239 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:59.185250 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:59.185305 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:59.185827 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:59.185827 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:59.185829 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:59.185878 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:59.185880 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.187204 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.187205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:59.188110 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:59.188113 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.188831 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.188832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:59.188926 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:59.188939 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 18:50:59.189014 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 18:50:59.189065 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":2,"thread_start_us":90,"threads_started":1}
I20260809 18:50:59.189154 12218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:59.185467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48174 (local address 127.12.202.194:45805)
0809 18:50:59.185666 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:59.185669 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:59.185679 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:50:59.185716 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:59.185718 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:59.185732 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:59.185956 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:59.186019 (+ 63us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.187101 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.188179 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.188723 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.188828 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:59.188938 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:59.189027 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 18:50:59.189064 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":98,"threads_started":1}
I20260809 18:50:59.189404 12215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:59.185245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60132 (local address 127.12.202.195:39637)
0809 18:50:59.185624 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:59.185628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:59.185638 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:50:59.185681 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:59.185683 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:59.185694 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:59.185977 (+ 283us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:59.186040 (+ 63us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.186703 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.188127 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.188892 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.188967 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:59.189051 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:59.189273 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 18:50:59.189312 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":123,"threads_started":1}
I20260809 18:50:59.189314 12211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:59.184944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:36301 (local address 127.0.0.1:38924)
0809 18:50:59.185077 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:59.185115 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:59.185203 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:59.185799 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:59.185803 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:59.185805 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:59.185878 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:59.185881 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.187167 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.187168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:59.188193 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:59.188195 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.189099 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.189100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:59.189151 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:59.189155 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:50:59.189187 (+ 32us) client_negotiation.cc:240] Negotiation successful
0809 18:50:59.189229 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":5,"thread_start_us":87,"threads_started":1}
I20260809 18:50:59.189597 12212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:59.184978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:39637 (local address 127.0.0.1:60132)
0809 18:50:59.185408 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:59.185417 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:59.185452 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:59.185848 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:59.185849 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:59.185852 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:59.185899 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:59.185901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.186801 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.186802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:59.188042 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:59.188044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.189089 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.189090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:59.189152 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:59.189158 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 18:50:59.189204 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 18:50:59.189233 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":86,"threads_started":1}
I20260809 18:50:59.190083 11885 tablet_service.cc:1467] Processing CreateTablet for tablet 34492d1081e343bb90621512518c37ae (DEFAULT_TABLE table=test-table [id=c2aa15c3ed524e08a05989aa6205cdc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:50:59.190310 12095 tablet_service.cc:1467] Processing CreateTablet for tablet 34492d1081e343bb90621512518c37ae (DEFAULT_TABLE table=test-table [id=c2aa15c3ed524e08a05989aa6205cdc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:50:59.190506 11885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34492d1081e343bb90621512518c37ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:59.190636 12095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34492d1081e343bb90621512518c37ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:59.193182 12220 tablet_bootstrap.cc:492] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6: Bootstrap starting.
I20260809 18:50:59.193249 12216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:59.185252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38924 (local address 127.12.202.193:36301)
0809 18:50:59.185602 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:59.185608 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:59.185621 (+ 13us) server_negotiation.cc:407] Connection header received
0809 18:50:59.185663 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:59.185665 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:59.185681 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:59.185958 (+ 277us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:59.186023 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.187072 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.188271 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.188996 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.189703 (+ 707us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:59.189805 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:59.189828 (+ 23us) server_negotiation.cc:299] Negotiation successful
0809 18:50:59.189868 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":120,"threads_started":1}
I20260809 18:50:59.193526 12221 tablet_bootstrap.cc:492] T 34492d1081e343bb90621512518c37ae P e0573de86ff7471a8ce7045fa358dba3: Bootstrap starting.
I20260809 18:50:59.193876 11669 tablet_service.cc:1467] Processing CreateTablet for tablet 34492d1081e343bb90621512518c37ae (DEFAULT_TABLE table=test-table [id=c2aa15c3ed524e08a05989aa6205cdc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:50:59.194139 12221 tablet_bootstrap.cc:654] T 34492d1081e343bb90621512518c37ae P e0573de86ff7471a8ce7045fa358dba3: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:59.194139 12220 tablet_bootstrap.cc:654] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:59.194229 11669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34492d1081e343bb90621512518c37ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:50:59.194504 12221 log.cc:824] T 34492d1081e343bb90621512518c37ae P e0573de86ff7471a8ce7045fa358dba3: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:59.194504 12220 log.cc:824] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:59.195349 12220 tablet_bootstrap.cc:492] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6: No bootstrap required, opened a new log
I20260809 18:50:59.195434 12220 ts_tablet_manager.cc:1397] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:50:59.195585 12221 tablet_bootstrap.cc:492] T 34492d1081e343bb90621512518c37ae P e0573de86ff7471a8ce7045fa358dba3: No bootstrap required, opened a new log
I20260809 18:50:59.195655 12221 ts_tablet_manager.cc:1397] T 34492d1081e343bb90621512518c37ae P e0573de86ff7471a8ce7045fa358dba3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:50:59.198226 12220 raft_consensus.cc:348] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0573de86ff7471a8ce7045fa358dba3" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45805 } } peers { permanent_uuid: "ddfdae5aae49403bbf03494292a21661" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36301 } } peers { permanent_uuid: "8ebf38ae057c4ccfb0ec1da2fbf149b6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 39637 } }
I20260809 18:50:59.198412 12220 raft_consensus.cc:374] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:59.198350 12221 raft_consensus.cc:348] T 34492d1081e343bb90621512518c37ae P e0573de86ff7471a8ce7045fa358dba3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0573de86ff7471a8ce7045fa358dba3" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45805 } } peers { permanent_uuid: "ddfdae5aae49403bbf03494292a21661" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36301 } } peers { permanent_uuid: "8ebf38ae057c4ccfb0ec1da2fbf149b6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 39637 } }
I20260809 18:50:59.198450 12220 raft_consensus.cc:729] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ebf38ae057c4ccfb0ec1da2fbf149b6, State: Initialized, Role: FOLLOWER
I20260809 18:50:59.198491 12221 raft_consensus.cc:374] T 34492d1081e343bb90621512518c37ae P e0573de86ff7471a8ce7045fa358dba3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:59.198532 12221 raft_consensus.cc:729] T 34492d1081e343bb90621512518c37ae P e0573de86ff7471a8ce7045fa358dba3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0573de86ff7471a8ce7045fa358dba3, State: Initialized, Role: FOLLOWER
I20260809 18:50:59.198596 12220 consensus_queue.cc:260] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0573de86ff7471a8ce7045fa358dba3" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45805 } } peers { permanent_uuid: "ddfdae5aae49403bbf03494292a21661" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36301 } } peers { permanent_uuid: "8ebf38ae057c4ccfb0ec1da2fbf149b6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 39637 } }
I20260809 18:50:59.198637 12221 consensus_queue.cc:260] T 34492d1081e343bb90621512518c37ae P e0573de86ff7471a8ce7045fa358dba3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0573de86ff7471a8ce7045fa358dba3" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45805 } } peers { permanent_uuid: "ddfdae5aae49403bbf03494292a21661" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36301 } } peers { permanent_uuid: "8ebf38ae057c4ccfb0ec1da2fbf149b6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 39637 } }
I20260809 18:50:59.198911 12221 ts_tablet_manager.cc:1428] T 34492d1081e343bb90621512518c37ae P e0573de86ff7471a8ce7045fa358dba3: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260809 18:50:59.198911 12220 ts_tablet_manager.cc:1428] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260809 18:50:59.198982 12198 heartbeater.cc:503] Master 127.12.202.254:42541 was elected leader, sending a full tablet report...
I20260809 18:50:59.198982 11989 heartbeater.cc:503] Master 127.12.202.254:42541 was elected leader, sending a full tablet report...
I20260809 18:50:59.199115 12228 tablet_bootstrap.cc:492] T 34492d1081e343bb90621512518c37ae P ddfdae5aae49403bbf03494292a21661: Bootstrap starting.
I20260809 18:50:59.199851 12228 tablet_bootstrap.cc:654] T 34492d1081e343bb90621512518c37ae P ddfdae5aae49403bbf03494292a21661: Neither blocks nor log segments found. Creating new log.
I20260809 18:50:59.200192 12228 log.cc:824] T 34492d1081e343bb90621512518c37ae P ddfdae5aae49403bbf03494292a21661: Log is configured to *not* fsync() on all Append() calls
I20260809 18:50:59.201030 12228 tablet_bootstrap.cc:492] T 34492d1081e343bb90621512518c37ae P ddfdae5aae49403bbf03494292a21661: No bootstrap required, opened a new log
I20260809 18:50:59.201151 12228 ts_tablet_manager.cc:1397] T 34492d1081e343bb90621512518c37ae P ddfdae5aae49403bbf03494292a21661: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:50:59.202921 12228 raft_consensus.cc:348] T 34492d1081e343bb90621512518c37ae P ddfdae5aae49403bbf03494292a21661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0573de86ff7471a8ce7045fa358dba3" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45805 } } peers { permanent_uuid: "ddfdae5aae49403bbf03494292a21661" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36301 } } peers { permanent_uuid: "8ebf38ae057c4ccfb0ec1da2fbf149b6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 39637 } }
I20260809 18:50:59.203090 12228 raft_consensus.cc:374] T 34492d1081e343bb90621512518c37ae P ddfdae5aae49403bbf03494292a21661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:50:59.203138 12228 raft_consensus.cc:729] T 34492d1081e343bb90621512518c37ae P ddfdae5aae49403bbf03494292a21661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfdae5aae49403bbf03494292a21661, State: Initialized, Role: FOLLOWER
I20260809 18:50:59.203254 12228 consensus_queue.cc:260] T 34492d1081e343bb90621512518c37ae P ddfdae5aae49403bbf03494292a21661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0573de86ff7471a8ce7045fa358dba3" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45805 } } peers { permanent_uuid: "ddfdae5aae49403bbf03494292a21661" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36301 } } peers { permanent_uuid: "8ebf38ae057c4ccfb0ec1da2fbf149b6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 39637 } }
I20260809 18:50:59.203510 12228 ts_tablet_manager.cc:1428] T 34492d1081e343bb90621512518c37ae P ddfdae5aae49403bbf03494292a21661: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 18:50:59.203600 11784 heartbeater.cc:503] Master 127.12.202.254:42541 was elected leader, sending a full tablet report...
I20260809 18:50:59.260015 12231 raft_consensus.cc:482] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:50:59.260169 12231 raft_consensus.cc:504] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0573de86ff7471a8ce7045fa358dba3" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45805 } } peers { permanent_uuid: "ddfdae5aae49403bbf03494292a21661" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36301 } } peers { permanent_uuid: "8ebf38ae057c4ccfb0ec1da2fbf149b6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 39637 } }
I20260809 18:50:59.260599 12231 leader_election.cc:288] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0573de86ff7471a8ce7045fa358dba3 (127.12.202.194:45805), ddfdae5aae49403bbf03494292a21661 (127.12.202.193:36301)
I20260809 18:50:59.263422 12202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:59.260752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:45805 (local address 127.12.202.195:55883)
0809 18:50:59.260810 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:59.260821 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:59.260865 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:59.261042 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:59.261043 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:59.261045 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:59.261156 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:59.261158 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.261874 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.261875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:59.262638 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:59.262640 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.263189 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.263190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:59.263259 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:59.263263 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:50:59.263311 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 18:50:59.263352 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 18:50:59.263443 12218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:59.260838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:55883 (local address 127.12.202.194:45805)
0809 18:50:59.260890 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:59.260892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:59.260920 (+ 28us) server_negotiation.cc:407] Connection header received
0809 18:50:59.260950 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:59.260952 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:59.260964 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:59.261022 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:59.261262 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.261768 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.262730 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.263115 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.263167 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:59.263174 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:59.263325 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 18:50:59.263365 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 18:50:59.263556 12236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:59.260763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:36301 (local address 127.12.202.195:38251)
0809 18:50:59.260964 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:59.260975 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:50:59.261046 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:50:59.261229 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:50:59.261230 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:50:59.261232 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:50:59.261301 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:59.261302 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.262007 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.262008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:59.262736 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:50:59.262738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.263269 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.263270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:50:59.263361 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:59.263365 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:50:59.263419 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 18:50:59.263451 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":116,"threads_started":1}
I20260809 18:50:59.263567 12216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:59.260919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:38251 (local address 127.12.202.193:36301)
0809 18:50:59.260983 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:59.260985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:59.261033 (+ 48us) server_negotiation.cc:407] Connection header received
0809 18:50:59.261128 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:59.261129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:59.261153 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:59.261210 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:50:59.261406 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.261924 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.262822 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.263196 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.263261 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:59.263268 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:59.263437 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 18:50:59.263492 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:50:59.263782 11912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34492d1081e343bb90621512518c37ae" candidate_uuid: "8ebf38ae057c4ccfb0ec1da2fbf149b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0573de86ff7471a8ce7045fa358dba3" is_pre_election: true
I20260809 18:50:59.263971 11912 raft_consensus.cc:2454] T 34492d1081e343bb90621512518c37ae P e0573de86ff7471a8ce7045fa358dba3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ebf38ae057c4ccfb0ec1da2fbf149b6 in term 0.
I20260809 18:50:59.264173 11704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34492d1081e343bb90621512518c37ae" candidate_uuid: "8ebf38ae057c4ccfb0ec1da2fbf149b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfdae5aae49403bbf03494292a21661" is_pre_election: true
I20260809 18:50:59.264279 12019 leader_election.cc:302] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ebf38ae057c4ccfb0ec1da2fbf149b6, e0573de86ff7471a8ce7045fa358dba3; no voters:
I20260809 18:50:59.264338 11704 raft_consensus.cc:2454] T 34492d1081e343bb90621512518c37ae P ddfdae5aae49403bbf03494292a21661 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ebf38ae057c4ccfb0ec1da2fbf149b6 in term 0.
I20260809 18:50:59.264434 12231 raft_consensus.cc:2781] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:50:59.264496 12231 raft_consensus.cc:482] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:50:59.264521 12231 raft_consensus.cc:3037] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:59.265237 12231 raft_consensus.cc:504] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0573de86ff7471a8ce7045fa358dba3" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45805 } } peers { permanent_uuid: "ddfdae5aae49403bbf03494292a21661" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36301 } } peers { permanent_uuid: "8ebf38ae057c4ccfb0ec1da2fbf149b6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 39637 } }
I20260809 18:50:59.265377 12231 leader_election.cc:288] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [CANDIDATE]: Term 1 election: Requested vote from peers e0573de86ff7471a8ce7045fa358dba3 (127.12.202.194:45805), ddfdae5aae49403bbf03494292a21661 (127.12.202.193:36301)
I20260809 18:50:59.265561 11912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34492d1081e343bb90621512518c37ae" candidate_uuid: "8ebf38ae057c4ccfb0ec1da2fbf149b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0573de86ff7471a8ce7045fa358dba3"
I20260809 18:50:59.265645 11912 raft_consensus.cc:3037] T 34492d1081e343bb90621512518c37ae P e0573de86ff7471a8ce7045fa358dba3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:59.266350 11912 raft_consensus.cc:2454] T 34492d1081e343bb90621512518c37ae P e0573de86ff7471a8ce7045fa358dba3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ebf38ae057c4ccfb0ec1da2fbf149b6 in term 1.
I20260809 18:50:59.266476 11704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34492d1081e343bb90621512518c37ae" candidate_uuid: "8ebf38ae057c4ccfb0ec1da2fbf149b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddfdae5aae49403bbf03494292a21661"
I20260809 18:50:59.266515 12019 leader_election.cc:302] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ebf38ae057c4ccfb0ec1da2fbf149b6, e0573de86ff7471a8ce7045fa358dba3; no voters:
I20260809 18:50:59.266574 11704 raft_consensus.cc:3037] T 34492d1081e343bb90621512518c37ae P ddfdae5aae49403bbf03494292a21661 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:50:59.266619 12231 raft_consensus.cc:2781] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:50:59.266793 12231 raft_consensus.cc:686] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [term 1 LEADER]: Becoming Leader. State: Replica: 8ebf38ae057c4ccfb0ec1da2fbf149b6, State: Running, Role: LEADER
I20260809 18:50:59.267016 12231 consensus_queue.cc:237] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0573de86ff7471a8ce7045fa358dba3" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45805 } } peers { permanent_uuid: "ddfdae5aae49403bbf03494292a21661" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36301 } } peers { permanent_uuid: "8ebf38ae057c4ccfb0ec1da2fbf149b6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 39637 } }
I20260809 18:50:59.267490 11704 raft_consensus.cc:2454] T 34492d1081e343bb90621512518c37ae P ddfdae5aae49403bbf03494292a21661 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ebf38ae057c4ccfb0ec1da2fbf149b6 in term 1.
I20260809 18:50:59.268050 11473 catalog_manager.cc:5495] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ebf38ae057c4ccfb0ec1da2fbf149b6 (127.12.202.195). New cstate: current_term: 1 leader_uuid: "8ebf38ae057c4ccfb0ec1da2fbf149b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0573de86ff7471a8ce7045fa358dba3" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfdae5aae49403bbf03494292a21661" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ebf38ae057c4ccfb0ec1da2fbf149b6" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 39637 } health_report { overall_health: HEALTHY } } }
W20260809 18:50:59.277622 11990 tablet.cc:2369] T 34492d1081e343bb90621512518c37ae P e0573de86ff7471a8ce7045fa358dba3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:50:59.280277 12215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:59.278229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60148 (local address 127.12.202.195:39637)
0809 18:50:59.278268 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 18:50:59.278270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:50:59.278278 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:50:59.278348 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:50:59.278349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:50:59.278365 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:50:59.278415 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:50:59.278494 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.278926 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.279608 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:50:59.279775 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:50:59.279823 (+ 48us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:50:59.279957 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:50:59.280034 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:50:59.280103 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 18:50:59.280207 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 18:50:59.280214 (+ 7us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 18:50:59.282055 11704 raft_consensus.cc:1261] T 34492d1081e343bb90621512518c37ae P ddfdae5aae49403bbf03494292a21661 [term 1 FOLLOWER]: Refusing update from remote peer 8ebf38ae057c4ccfb0ec1da2fbf149b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:50:59.282269 11912 raft_consensus.cc:1261] T 34492d1081e343bb90621512518c37ae P e0573de86ff7471a8ce7045fa358dba3 [term 1 FOLLOWER]: Refusing update from remote peer 8ebf38ae057c4ccfb0ec1da2fbf149b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:50:59.282343 12237 consensus_queue.cc:1035] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddfdae5aae49403bbf03494292a21661" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 36301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:50:59.282495 12231 consensus_queue.cc:1035] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0573de86ff7471a8ce7045fa358dba3" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 45805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:50:59.284860 12246 mvcc.cc:205] Tried to move back new op lower bound from 7316690777216659456 to 7316690777158569984. Current Snapshot: MvccSnapshot[applied={T|T < 7316690777216659456}]
I20260809 18:50:59.287139 11470 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50596:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:50:59.287226 11470 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50596:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:50:59.287964 11470 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6937dec089db47739931d0bb6bf56a1d: Sending DeleteTablet for 3 replicas of tablet 34492d1081e343bb90621512518c37ae
I20260809 18:50:59.288317 12095 tablet_service.cc:1514] Processing DeleteTablet for tablet 34492d1081e343bb90621512518c37ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:50:59 UTC) from {username='slave'} at 127.0.0.1:60132
I20260809 18:50:59.288362 11669 tablet_service.cc:1514] Processing DeleteTablet for tablet 34492d1081e343bb90621512518c37ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:50:59 UTC) from {username='slave'} at 127.0.0.1:38924
I20260809 18:50:59.288354 11885 tablet_service.cc:1514] Processing DeleteTablet for tablet 34492d1081e343bb90621512518c37ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:50:59 UTC) from {username='slave'} at 127.0.0.1:48174
I20260809 18:50:59.288564 12272 tablet_replica.cc:330] T 34492d1081e343bb90621512518c37ae P ddfdae5aae49403bbf03494292a21661: stopping tablet replica
I20260809 18:50:59.288661 12272 raft_consensus.cc:2229] T 34492d1081e343bb90621512518c37ae P ddfdae5aae49403bbf03494292a21661 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:50:59.288759 12272 raft_consensus.cc:2258] T 34492d1081e343bb90621512518c37ae P ddfdae5aae49403bbf03494292a21661 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:50:59.288910 12268 tablet_replica.cc:330] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6: stopping tablet replica
I20260809 18:50:59.288908 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 11572
I20260809 18:50:59.298264 12268 raft_consensus.cc:2229] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:50:59.298480 12268 raft_consensus.cc:2258] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:50:59.299039 12268 ts_tablet_manager.cc:1905] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:50:59.301800 12268 ts_tablet_manager.cc:1918] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:50:59.301893 12268 log.cc:1196] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/34492d1081e343bb90621512518c37ae
I20260809 18:50:59.302173 12268 ts_tablet_manager.cc:1939] T 34492d1081e343bb90621512518c37ae P 8ebf38ae057c4ccfb0ec1da2fbf149b6: Deleting consensus metadata
I20260809 18:50:59.302661 11455 catalog_manager.cc:4841] TS 8ebf38ae057c4ccfb0ec1da2fbf149b6 (127.12.202.195:39637): tablet 34492d1081e343bb90621512518c37ae (table test-table [id=c2aa15c3ed524e08a05989aa6205cdc8]) successfully deleted
W20260809 18:50:59.307813 11446 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.202.193:36301 (error 108)
I20260809 18:50:59.308261 12273 tablet_replica.cc:330] T 34492d1081e343bb90621512518c37ae P e0573de86ff7471a8ce7045fa358dba3: stopping tablet replica
I20260809 18:50:59.308347 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 11787
I20260809 18:50:59.308431 12212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:59.308270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:36301 (local address 127.0.0.1:38936)
0809 18:50:59.308348 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:59.308390 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:36301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 18:50:59.312629 11446 catalog_manager.cc:4584] TS ddfdae5aae49403bbf03494292a21661 (127.12.202.193:36301): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 34492d1081e343bb90621512518c37ae: Network error: Client connection negotiation failed: client connection to 127.12.202.193:36301: connect: Connection refused (error 111)
I20260809 18:50:59.325752 12212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:50:59.325628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:45805 (local address 127.0.0.1:48182)
0809 18:50:59.325683 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 18:50:59.325709 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.194:45805: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 18:50:59.325886 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 11992
I20260809 18:50:59.336925 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 11423
2026-08-09T18:50:59Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (762 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:50:59 dist-test-slave-45dx krb5kdc[12278](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:50:59 dist-test-slave-45dx krb5kdc[12278](info): set up 2 sockets
Aug 09 18:50:59 dist-test-slave-45dx krb5kdc[12278](info): commencing operation
krb5kdc: starting...
W20260809 18:51:00.590907 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:00 dist-test-slave-45dx krb5kdc[12278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:51:00.710911 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:42713
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:42713
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:00.793023 12300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:00.793222 12300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:00.793244 12300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:00.794395 12300 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:00.794438 12300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:00.794452 12300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:00.794464 12300 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:00.794477 12300 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:00.796039 12300 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:42713
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:42713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:00.796308 12300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:00.796592 12300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:00.801586 12308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:00.801610 12307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:00.801599 12313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:00.801858 12300 server_base.cc:1034] running on GCE node
I20260809 18:51:00.802117 12300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:00.802371 12300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:00.803558 12300 hybrid_clock.cc:648] HybridClock initialized: now 1786301460803545 us; error 27 us; skew 500 ppm
Aug 09 18:51:00 dist-test-slave-45dx krb5kdc[12278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301460, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:00.806272 12300 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:51:00.806768 12300 webserver.cc:460] Webserver started at http://127.12.202.254:36461/ using document root <none> and password file <none>
I20260809 18:51:00.807027 12300 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:00.807101 12300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:00.807251 12300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:00.808369 12300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "3dd32a9b81fd445387da7b8026f55eb3"
format_stamp: "Formatted at 2026-08-09 18:51:00 on dist-test-slave-45dx"
server_key: "96c093111ef99b950c87c65e7dc2fc7b"
server_key_iv: "c394dd6338feb67394650d40a958e4b9"
server_key_version: "encryptionkey@0"
I20260809 18:51:00.808759 12300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "3dd32a9b81fd445387da7b8026f55eb3"
format_stamp: "Formatted at 2026-08-09 18:51:00 on dist-test-slave-45dx"
server_key: "96c093111ef99b950c87c65e7dc2fc7b"
server_key_iv: "c394dd6338feb67394650d40a958e4b9"
server_key_version: "encryptionkey@0"
I20260809 18:51:00.810086 12300 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:51:00.810791 12321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:00.810977 12300 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:51:00.811082 12300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "3dd32a9b81fd445387da7b8026f55eb3"
format_stamp: "Formatted at 2026-08-09 18:51:00 on dist-test-slave-45dx"
server_key: "96c093111ef99b950c87c65e7dc2fc7b"
server_key_iv: "c394dd6338feb67394650d40a958e4b9"
server_key_version: "encryptionkey@0"
I20260809 18:51:00.811162 12300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:00.840540 12300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:00.843089 12300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:00.843263 12300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:00.847477 12300 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:42713
I20260809 18:51:00.847523 12410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:42713 every 8 connection(s)
I20260809 18:51:00.847900 12300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:00.848804 12413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:00.851058 12413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3: Bootstrap starting.
I20260809 18:51:00.851606 12413 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:00.851847 12413 log.cc:824] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:00.852509 12413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3: No bootstrap required, opened a new log
I20260809 18:51:00.853991 12413 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dd32a9b81fd445387da7b8026f55eb3" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42713 } }
I20260809 18:51:00.854120 12413 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:00.854142 12413 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dd32a9b81fd445387da7b8026f55eb3, State: Initialized, Role: FOLLOWER
I20260809 18:51:00.854276 12413 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dd32a9b81fd445387da7b8026f55eb3" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42713 } }
I20260809 18:51:00.854372 12413 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:00.854395 12413 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:00.854429 12413 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:00.854904 12413 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dd32a9b81fd445387da7b8026f55eb3" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42713 } }
I20260809 18:51:00.854986 12413 leader_election.cc:302] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3dd32a9b81fd445387da7b8026f55eb3; no voters:
I20260809 18:51:00.855104 12413 leader_election.cc:288] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:00.855172 12417 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:00.855332 12417 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3 [term 1 LEADER]: Becoming Leader. State: Replica: 3dd32a9b81fd445387da7b8026f55eb3, State: Running, Role: LEADER
I20260809 18:51:00.855365 12413 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:00.855419 12417 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dd32a9b81fd445387da7b8026f55eb3" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42713 } }
I20260809 18:51:00.855806 12423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3dd32a9b81fd445387da7b8026f55eb3. Latest consensus state: current_term: 1 leader_uuid: "3dd32a9b81fd445387da7b8026f55eb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dd32a9b81fd445387da7b8026f55eb3" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42713 } } }
I20260809 18:51:00.855906 12423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:00.855922 12419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3dd32a9b81fd445387da7b8026f55eb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dd32a9b81fd445387da7b8026f55eb3" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 42713 } } }
I20260809 18:51:00.855976 12419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:00.856115 12432 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:00.856231 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 12300
I20260809 18:51:00.856386 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:00.856606 13099 external_mini_cluster.cc:1428] Setting key bceab93b34d3b1bf26adec7457e8d651
I20260809 18:51:00.856679 12432 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:00.858331 12432 catalog_manager.cc:1347] Generated new cluster ID: 2fea281cd87b47b085b58f7a813a6596
I20260809 18:51:00.858392 12432 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:51:00 dist-test-slave-45dx krb5kdc[12278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:51:00.868047 12449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:00.857125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47002 (local address 127.12.202.254:42713)
0809 18:51:00.857475 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:00.857483 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:00.857512 (+ 29us) server_negotiation.cc:407] Connection header received
0809 18:51:00.857615 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:00.857621 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:00.857672 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:00.857803 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:00.858591 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:00.859940 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:00.861046 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:00.861661 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:00.861766 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:00.864501 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:00.864504 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:00.864504 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:00.864515 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:00.866405 (+ 1890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:00.866801 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:00.866804 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:00.866804 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:00.866939 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:00.867182 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:00.867183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:00.867183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:00.867460 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:00.867610 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:00.867718 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 18:51:00.867841 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":65,"threads_started":1}
I20260809 18:51:00.879369 12432 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:00.880033 12432 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:00.883358 12432 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3: Generated new TSK 0
I20260809 18:51:00.883546 12432 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.202.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
Entry for principal kudu/127.12.202.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab.
I20260809 18:51:00.911492 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42713
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:00.994707 12466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:00.994921 12466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:00.994946 12466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:00.996165 12466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:00.996206 12466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:00.996232 12466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:51:00.997764 12466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.193.keytab
--principal=kudu/127.12.202.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42713
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:00.998018 12466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:00.998278 12466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:01.003549 12472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:01.003579 12476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:01.003545 12478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:01.003728 12466 server_base.cc:1034] running on GCE node
I20260809 18:51:01.004046 12466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:01.004277 12466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:01.005512 12466 hybrid_clock.cc:648] HybridClock initialized: now 1786301461005503 us; error 35 us; skew 500 ppm
Aug 09 18:51:01 dist-test-slave-45dx krb5kdc[12278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301461, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:01.008396 12466 init.cc:377] Logged in from keytab as kudu/127.12.202.193@KRBTEST.COM (short username kudu)
I20260809 18:51:01.008845 12466 webserver.cc:460] Webserver started at http://127.12.202.193:46773/ using document root <none> and password file <none>
I20260809 18:51:01.009083 12466 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:01.009155 12466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:01.009313 12466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:01.010401 12466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "1dbdb919a3a54e28afc13ff2e89e5a49"
format_stamp: "Formatted at 2026-08-09 18:51:01 on dist-test-slave-45dx"
server_key: "236fa8c072ac091e7f4699ec3aabaa2d"
server_key_iv: "c9a86e726e31ab69a754007886ca02c0"
server_key_version: "encryptionkey@0"
I20260809 18:51:01.010779 12466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "1dbdb919a3a54e28afc13ff2e89e5a49"
format_stamp: "Formatted at 2026-08-09 18:51:01 on dist-test-slave-45dx"
server_key: "236fa8c072ac091e7f4699ec3aabaa2d"
server_key_iv: "c9a86e726e31ab69a754007886ca02c0"
server_key_version: "encryptionkey@0"
I20260809 18:51:01.012166 12466 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:51:01.012993 12490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:01.013203 12466 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:51:01.013341 12466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "1dbdb919a3a54e28afc13ff2e89e5a49"
format_stamp: "Formatted at 2026-08-09 18:51:01 on dist-test-slave-45dx"
server_key: "236fa8c072ac091e7f4699ec3aabaa2d"
server_key_iv: "c9a86e726e31ab69a754007886ca02c0"
server_key_version: "encryptionkey@0"
I20260809 18:51:01.013422 12466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:01.054425 12466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:01.057226 12466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:01.057415 12466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:01.057709 12466 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:51:01.058065 12466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:51:01.058126 12466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:01.058166 12466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:51:01.058211 12466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:01.066128 12466 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:45769
I20260809 18:51:01.066268 12662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:45769 every 8 connection(s)
I20260809 18:51:01.067108 12466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
Aug 09 18:51:01 dist-test-slave-45dx krb5kdc[12278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301461, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.193@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:51:01.077397 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 12466
I20260809 18:51:01.077525 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:51:01.077749 13099 external_mini_cluster.cc:1428] Setting key 094582ea58862334556cb3c610818007
I20260809 18:51:01.080145 12449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.069021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:45019 (local address 127.12.202.254:42713)
0809 18:51:01.069191 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:01.069196 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:01.069512 (+ 316us) server_negotiation.cc:407] Connection header received
0809 18:51:01.070298 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:01.070300 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:01.070321 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:01.070437 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:01.071986 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.072756 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.073999 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.074228 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.074315 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.076834 (+ 2519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:01.076835 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:01.076836 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:01.076843 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:01.078636 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:01.079084 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:01.079085 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:01.079086 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:01.079153 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:01.079419 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:01.079420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:01.079421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:01.079549 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:01.079622 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:01.079941 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 18:51:01.080050 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 18:51:01.080585 12665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.068974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42713 (local address 127.12.202.193:45019)
0809 18:51:01.069299 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:01.069371 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:01.070125 (+ 754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:01.070580 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:01.070586 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:01.071436 (+ 850us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:01.071770 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:01.071780 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.072894 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.072900 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:01.073866 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:01.073869 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.074328 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.074330 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:01.074488 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.075104 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:01.075114 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:01.076707 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:01.078730 (+ 2023us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:01.078738 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:01.078740 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:01.078999 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:01.079221 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:01.079222 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:01.079223 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:01.079344 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:01.079627 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:01.079635 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:01.079783 (+ 148us) client_negotiation.cc:769] Sending connection context
0809 18:51:01.079903 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 18:51:01.080079 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":152,"threads_started":1}
I20260809 18:51:01.081378 12663 heartbeater.cc:347] Connected to a master server at 127.12.202.254:42713
I20260809 18:51:01.081498 12663 heartbeater.cc:464] Registering TS with master...
I20260809 18:51:01.081692 12663 heartbeater.cc:511] Master 127.12.202.254:42713 requested a full tablet report, sending...
I20260809 18:51:01.082345 12346 ts_manager.cc:194] Registered new tserver with Master: 1dbdb919a3a54e28afc13ff2e89e5a49 (127.12.202.193:45769)
I20260809 18:51:01.083328 12346 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.193@KRBTEST.COM'} at 127.12.202.193:45019
WARNING: no policy specified for kudu/127.12.202.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
Entry for principal kudu/127.12.202.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab.
I20260809 18:51:01.109249 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42713
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:01.196954 12671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:01.197157 12671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:01.197181 12671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:01.198385 12671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:01.198429 12671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:01.198455 12671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:51:01.199893 12671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.194.keytab
--principal=kudu/127.12.202.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42713
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:01.200177 12671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:01.200443 12671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:01.205837 12680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:01.205873 12679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:01.205873 12687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:01.206112 12671 server_base.cc:1034] running on GCE node
I20260809 18:51:01.206324 12671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:01.206573 12671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:01.207770 12671 hybrid_clock.cc:648] HybridClock initialized: now 1786301461207744 us; error 40 us; skew 500 ppm
Aug 09 18:51:01 dist-test-slave-45dx krb5kdc[12278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301461, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:01.210449 12671 init.cc:377] Logged in from keytab as kudu/127.12.202.194@KRBTEST.COM (short username kudu)
I20260809 18:51:01.210953 12671 webserver.cc:460] Webserver started at http://127.12.202.194:35051/ using document root <none> and password file <none>
I20260809 18:51:01.211215 12671 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:01.211292 12671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:01.211463 12671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:01.212598 12671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "bf3c7c4f77a045a98bd646d73222de3d"
format_stamp: "Formatted at 2026-08-09 18:51:01 on dist-test-slave-45dx"
server_key: "91101d7c4a5062a5f2a83f1094acf07e"
server_key_iv: "55e860c4a84980771b680c319fb4184a"
server_key_version: "encryptionkey@0"
I20260809 18:51:01.212962 12671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "bf3c7c4f77a045a98bd646d73222de3d"
format_stamp: "Formatted at 2026-08-09 18:51:01 on dist-test-slave-45dx"
server_key: "91101d7c4a5062a5f2a83f1094acf07e"
server_key_iv: "55e860c4a84980771b680c319fb4184a"
server_key_version: "encryptionkey@0"
I20260809 18:51:01.214336 12671 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:51:01.215162 12697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:01.215332 12671 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:51:01.215444 12671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "bf3c7c4f77a045a98bd646d73222de3d"
format_stamp: "Formatted at 2026-08-09 18:51:01 on dist-test-slave-45dx"
server_key: "91101d7c4a5062a5f2a83f1094acf07e"
server_key_iv: "55e860c4a84980771b680c319fb4184a"
server_key_version: "encryptionkey@0"
I20260809 18:51:01.215523 12671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:01.230219 12671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:01.232874 12671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:01.233091 12671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:01.233354 12671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:51:01.233711 12671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:51:01.233768 12671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:01.233825 12671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:51:01.233855 12671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:01.239949 12671 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:42887
I20260809 18:51:01.240007 12877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:42887 every 8 connection(s)
I20260809 18:51:01.240356 12671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:51:01.246698 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 12671
I20260809 18:51:01.246860 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:51:01.247099 13099 external_mini_cluster.cc:1428] Setting key bb3a3756607a488fd882153abe86da54
Aug 09 18:51:01 dist-test-slave-45dx krb5kdc[12278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301461, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.194@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:51:01.256389 12449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.241112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:59725 (local address 127.12.202.254:42713)
0809 18:51:01.241164 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:01.241167 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:01.241369 (+ 202us) server_negotiation.cc:407] Connection header received
0809 18:51:01.241974 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:01.241976 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:01.241991 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:01.242038 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:01.243386 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.244069 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.245403 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.245735 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.245814 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.248818 (+ 3004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:01.248819 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:01.248819 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:01.248834 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:01.250615 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:01.255180 (+ 4565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:01.255198 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:01.255198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:01.255278 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:01.255601 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:01.255602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:01.255602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:01.255748 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:01.255796 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:01.256126 (+ 330us) server_negotiation.cc:299] Negotiation successful
0809 18:51:01.256220 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:51:01.256907 12888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.241043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42713 (local address 127.12.202.194:59725)
0809 18:51:01.241216 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:01.241268 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:01.241845 (+ 577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:01.242110 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:01.242114 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:01.242948 (+ 834us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:01.243263 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:01.243276 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.244216 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.244217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:01.245295 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:01.245299 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.245845 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.245846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:01.246041 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.246638 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:01.246648 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:01.248675 (+ 2027us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:01.253130 (+ 4455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:01.253140 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:01.253143 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:01.253611 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:01.255376 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:01.255377 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:01.255377 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:01.255528 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:01.255824 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:01.255830 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:01.255998 (+ 168us) client_negotiation.cc:769] Sending connection context
0809 18:51:01.256540 (+ 542us) client_negotiation.cc:240] Negotiation successful
0809 18:51:01.256728 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":75,"threads_started":1}
I20260809 18:51:01.257490 12879 heartbeater.cc:347] Connected to a master server at 127.12.202.254:42713
I20260809 18:51:01.257607 12879 heartbeater.cc:464] Registering TS with master...
I20260809 18:51:01.257812 12879 heartbeater.cc:511] Master 127.12.202.254:42713 requested a full tablet report, sending...
I20260809 18:51:01.258242 12346 ts_manager.cc:194] Registered new tserver with Master: bf3c7c4f77a045a98bd646d73222de3d (127.12.202.194:42887)
I20260809 18:51:01.258631 12346 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.194@KRBTEST.COM'} at 127.12.202.194:59725
WARNING: no policy specified for kudu/127.12.202.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
Entry for principal kudu/127.12.202.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab.
I20260809 18:51:01.280187 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42713
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:01.364750 12892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:01.364984 12892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:01.365008 12892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:01.366161 12892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:01.366200 12892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:01.366227 12892 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:51:01.367676 12892 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.195.keytab
--principal=kudu/127.12.202.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:42713
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12892
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:01.367873 12892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:01.368131 12892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:01.373531 12901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:01.373546 12904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:01.373549 12902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:01.373800 12892 server_base.cc:1034] running on GCE node
I20260809 18:51:01.374024 12892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:01.374279 12892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:01.375447 12892 hybrid_clock.cc:648] HybridClock initialized: now 1786301461375433 us; error 26 us; skew 500 ppm
Aug 09 18:51:01 dist-test-slave-45dx krb5kdc[12278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301461, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:01.378000 12892 init.cc:377] Logged in from keytab as kudu/127.12.202.195@KRBTEST.COM (short username kudu)
I20260809 18:51:01.378482 12892 webserver.cc:460] Webserver started at http://127.12.202.195:43239/ using document root <none> and password file <none>
I20260809 18:51:01.378712 12892 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:01.378780 12892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:01.378942 12892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:01.380008 12892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "552360ec9bfc4a12b6b6df21dfc5b4af"
format_stamp: "Formatted at 2026-08-09 18:51:01 on dist-test-slave-45dx"
server_key: "5bf2b8761f509a11c38367ca70c9499a"
server_key_iv: "c3d16053b3efedd965ef073f76dbd015"
server_key_version: "encryptionkey@0"
I20260809 18:51:01.380460 12892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "552360ec9bfc4a12b6b6df21dfc5b4af"
format_stamp: "Formatted at 2026-08-09 18:51:01 on dist-test-slave-45dx"
server_key: "5bf2b8761f509a11c38367ca70c9499a"
server_key_iv: "c3d16053b3efedd965ef073f76dbd015"
server_key_version: "encryptionkey@0"
I20260809 18:51:01.381824 12892 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:51:01.382622 12911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:01.382812 12892 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:51:01.382930 12892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "552360ec9bfc4a12b6b6df21dfc5b4af"
format_stamp: "Formatted at 2026-08-09 18:51:01 on dist-test-slave-45dx"
server_key: "5bf2b8761f509a11c38367ca70c9499a"
server_key_iv: "c3d16053b3efedd965ef073f76dbd015"
server_key_version: "encryptionkey@0"
I20260809 18:51:01.383021 12892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:01.420239 12892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:01.422299 12892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:01.422470 12892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:01.422725 12892 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:51:01.423058 12892 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:51:01.423115 12892 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:01.423149 12892 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:51:01.423182 12892 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:01.429409 12892 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:46187
I20260809 18:51:01.429452 13092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:46187 every 8 connection(s)
I20260809 18:51:01.429780 12892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
Aug 09 18:51:01 dist-test-slave-45dx krb5kdc[12278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301461, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.195@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:51:01.436528 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 12892
I20260809 18:51:01.436661 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:51:01.436870 13099 external_mini_cluster.cc:1428] Setting key 71d8925c357ab03be9a94de05ae363b0
I20260809 18:51:01.439004 12449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.430559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:57947 (local address 127.12.202.254:42713)
0809 18:51:01.430605 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:01.430608 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:01.430807 (+ 199us) server_negotiation.cc:407] Connection header received
0809 18:51:01.431288 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:01.431288 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:01.431298 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:01.431356 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:01.432241 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.432805 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.433764 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.433946 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.433995 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.436031 (+ 2036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:01.436032 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:01.436033 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:01.436039 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:01.437812 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:01.438225 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:01.438226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:01.438226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:01.438282 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:01.438488 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:01.438488 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:01.438488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:01.438587 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:01.438635 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:01.438853 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 18:51:01.438927 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:51:01.439200 13096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.430525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:42713 (local address 127.12.202.195:57947)
0809 18:51:01.430684 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:01.430720 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:01.431203 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:01.431416 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:01.431419 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:01.431982 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:01.432167 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:01.432172 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.432904 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.432905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:01.433687 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:01.433689 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.434019 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.434020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:01.434115 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.434560 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:01.434568 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:01.435948 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:01.437883 (+ 1935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:01.437888 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:01.437889 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:01.438162 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:01.438321 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:01.438321 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:01.438321 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:01.438437 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:01.438625 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:01.438628 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:01.438730 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 18:51:01.438822 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 18:51:01.438954 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":95,"threads_started":1}
I20260809 18:51:01.439606 13093 heartbeater.cc:347] Connected to a master server at 127.12.202.254:42713
I20260809 18:51:01.439688 13093 heartbeater.cc:464] Registering TS with master...
I20260809 18:51:01.439924 13093 heartbeater.cc:511] Master 127.12.202.254:42713 requested a full tablet report, sending...
I20260809 18:51:01.440372 12346 ts_manager.cc:194] Registered new tserver with Master: 552360ec9bfc4a12b6b6df21dfc5b4af (127.12.202.195:46187)
I20260809 18:51:01.440742 12346 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.202.195@KRBTEST.COM'} at 127.12.202.195:57947
I20260809 18:51:01.448647 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:51:01.456465 12449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.450045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47016 (local address 127.12.202.254:42713)
0809 18:51:01.450135 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:01.450138 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:01.450229 (+ 91us) server_negotiation.cc:407] Connection header received
0809 18:51:01.450319 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:01.450320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:01.450330 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:01.450398 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:01.450961 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.451459 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.452201 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.452512 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.452601 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.453788 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:01.453789 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:01.453790 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:01.453798 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:01.455087 (+ 1289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:01.455440 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:01.455442 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:01.455442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:01.455505 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:01.455736 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:01.455737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:01.455738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:01.455984 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:01.456120 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:01.456239 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 18:51:01.456362 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 18:51:01.458074 12346 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47016:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:51:01.459698 12346 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:51:01.466342 13120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.462241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:42887 (local address 127.0.0.1:42084)
0809 18:51:01.462356 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:01.462401 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:01.462493 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:01.462948 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:01.462951 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:01.462953 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:51:01.463023 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:01.463025 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.464351 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.464352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:01.465389 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:01.465391 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.466049 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.466050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:01.466130 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.466143 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 18:51:01.466212 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 18:51:01.466267 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"mutex_wait_us":30,"thread_start_us":59,"threads_started":1}
I20260809 18:51:01.466356 13125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.462497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42084 (local address 127.12.202.194:42887)
0809 18:51:01.462739 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:01.462744 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:01.462755 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:51:01.462798 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:01.462800 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:01.462816 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:01.462896 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:51:01.463095 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.464228 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.465478 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.465948 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.466050 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.466109 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:01.466237 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 18:51:01.466280 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":104,"threads_started":1}
I20260809 18:51:01.466558 13127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.462575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:45769 (local address 127.0.0.1:56450)
0809 18:51:01.463016 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:01.463026 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:01.463066 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:01.463320 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:01.463321 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:01.463322 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:51:01.463352 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:01.463353 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.464512 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.464514 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:01.465386 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:01.465389 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.466315 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.466315 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:01.466377 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.466381 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:51:01.466429 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 18:51:01.466478 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":417,"mutex_wait_us":33,"thread_start_us":87,"threads_started":1}
I20260809 18:51:01.466861 13128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.462750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56450 (local address 127.12.202.193:45769)
0809 18:51:01.463169 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:01.463175 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:01.463184 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:51:01.463220 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:01.463222 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:01.463237 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:01.463322 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:51:01.463397 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.464416 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.465495 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.466158 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.466226 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.466273 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:01.466716 (+ 443us) server_negotiation.cc:299] Negotiation successful
0809 18:51:01.466763 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":100,"threads_started":1}
I20260809 18:51:01.466919 13121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.462295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:46187 (local address 127.0.0.1:41980)
0809 18:51:01.462700 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:01.462712 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:01.462770 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:01.463144 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:01.463145 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:01.463146 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:51:01.463198 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:01.463199 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.464095 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.464097 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:01.465358 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:01.465361 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.466312 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.466314 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:01.466382 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.466385 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:51:01.466801 (+ 416us) client_negotiation.cc:240] Negotiation successful
0809 18:51:01.466842 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"mutex_wait_us":2,"thread_start_us":92,"threads_started":1}
I20260809 18:51:01.467255 13122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.462309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41980 (local address 127.12.202.195:46187)
0809 18:51:01.462902 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:01.462906 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:01.462916 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:51:01.462967 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:01.462970 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:01.462985 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:01.463060 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:51:01.463274 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.463995 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.465453 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.466154 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.466226 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.466274 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:01.466827 (+ 553us) server_negotiation.cc:299] Negotiation successful
0809 18:51:01.466882 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":550,"thread_start_us":110,"threads_started":1}
I20260809 18:51:01.467144 12772 tablet_service.cc:1467] Processing CreateTablet for tablet 9aeba812d0124e3f95946406541e4633 (DEFAULT_TABLE table=test-table [id=ceb69f1b153b41f18b43d75ed9dfc01a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:51:01.467523 12772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9aeba812d0124e3f95946406541e4633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:01.467573 12566 tablet_service.cc:1467] Processing CreateTablet for tablet 9aeba812d0124e3f95946406541e4633 (DEFAULT_TABLE table=test-table [id=ceb69f1b153b41f18b43d75ed9dfc01a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:51:01.467952 12566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9aeba812d0124e3f95946406541e4633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:01.470278 13130 tablet_bootstrap.cc:492] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d: Bootstrap starting.
I20260809 18:51:01.470623 13132 tablet_bootstrap.cc:492] T 9aeba812d0124e3f95946406541e4633 P 1dbdb919a3a54e28afc13ff2e89e5a49: Bootstrap starting.
I20260809 18:51:01.471082 13130 tablet_bootstrap.cc:654] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:01.470956 12991 tablet_service.cc:1467] Processing CreateTablet for tablet 9aeba812d0124e3f95946406541e4633 (DEFAULT_TABLE table=test-table [id=ceb69f1b153b41f18b43d75ed9dfc01a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:51:01.471241 13132 tablet_bootstrap.cc:654] T 9aeba812d0124e3f95946406541e4633 P 1dbdb919a3a54e28afc13ff2e89e5a49: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:01.471319 12991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9aeba812d0124e3f95946406541e4633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:01.471726 13130 log.cc:824] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:01.471773 13132 log.cc:824] T 9aeba812d0124e3f95946406541e4633 P 1dbdb919a3a54e28afc13ff2e89e5a49: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:01.472556 13130 tablet_bootstrap.cc:492] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d: No bootstrap required, opened a new log
I20260809 18:51:01.472556 13132 tablet_bootstrap.cc:492] T 9aeba812d0124e3f95946406541e4633 P 1dbdb919a3a54e28afc13ff2e89e5a49: No bootstrap required, opened a new log
I20260809 18:51:01.472630 13130 ts_tablet_manager.cc:1397] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:51:01.472662 13132 ts_tablet_manager.cc:1397] T 9aeba812d0124e3f95946406541e4633 P 1dbdb919a3a54e28afc13ff2e89e5a49: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:51:01.474113 13136 tablet_bootstrap.cc:492] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af: Bootstrap starting.
I20260809 18:51:01.474695 13136 tablet_bootstrap.cc:654] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:01.474624 13130 raft_consensus.cc:348] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3c7c4f77a045a98bd646d73222de3d" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 42887 } } peers { permanent_uuid: "552360ec9bfc4a12b6b6df21dfc5b4af" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46187 } } peers { permanent_uuid: "1dbdb919a3a54e28afc13ff2e89e5a49" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45769 } }
I20260809 18:51:01.474812 13130 raft_consensus.cc:374] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:01.474715 13132 raft_consensus.cc:348] T 9aeba812d0124e3f95946406541e4633 P 1dbdb919a3a54e28afc13ff2e89e5a49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3c7c4f77a045a98bd646d73222de3d" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 42887 } } peers { permanent_uuid: "552360ec9bfc4a12b6b6df21dfc5b4af" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46187 } } peers { permanent_uuid: "1dbdb919a3a54e28afc13ff2e89e5a49" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45769 } }
I20260809 18:51:01.474866 13132 raft_consensus.cc:374] T 9aeba812d0124e3f95946406541e4633 P 1dbdb919a3a54e28afc13ff2e89e5a49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:01.474860 13130 raft_consensus.cc:729] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf3c7c4f77a045a98bd646d73222de3d, State: Initialized, Role: FOLLOWER
I20260809 18:51:01.474900 13132 raft_consensus.cc:729] T 9aeba812d0124e3f95946406541e4633 P 1dbdb919a3a54e28afc13ff2e89e5a49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dbdb919a3a54e28afc13ff2e89e5a49, State: Initialized, Role: FOLLOWER
I20260809 18:51:01.474982 13130 consensus_queue.cc:260] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3c7c4f77a045a98bd646d73222de3d" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 42887 } } peers { permanent_uuid: "552360ec9bfc4a12b6b6df21dfc5b4af" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46187 } } peers { permanent_uuid: "1dbdb919a3a54e28afc13ff2e89e5a49" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45769 } }
I20260809 18:51:01.475033 13132 consensus_queue.cc:260] T 9aeba812d0124e3f95946406541e4633 P 1dbdb919a3a54e28afc13ff2e89e5a49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3c7c4f77a045a98bd646d73222de3d" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 42887 } } peers { permanent_uuid: "552360ec9bfc4a12b6b6df21dfc5b4af" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46187 } } peers { permanent_uuid: "1dbdb919a3a54e28afc13ff2e89e5a49" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45769 } }
I20260809 18:51:01.475270 13130 ts_tablet_manager.cc:1428] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:51:01.475270 13132 ts_tablet_manager.cc:1428] T 9aeba812d0124e3f95946406541e4633 P 1dbdb919a3a54e28afc13ff2e89e5a49: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260809 18:51:01.475381 13136 log.cc:824] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:01.475409 12663 heartbeater.cc:503] Master 127.12.202.254:42713 was elected leader, sending a full tablet report...
I20260809 18:51:01.475425 12879 heartbeater.cc:503] Master 127.12.202.254:42713 was elected leader, sending a full tablet report...
I20260809 18:51:01.476274 13136 tablet_bootstrap.cc:492] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af: No bootstrap required, opened a new log
I20260809 18:51:01.476375 13136 ts_tablet_manager.cc:1397] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:51:01.476672 13137 raft_consensus.cc:482] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:51:01.476752 13137 raft_consensus.cc:504] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3c7c4f77a045a98bd646d73222de3d" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 42887 } } peers { permanent_uuid: "552360ec9bfc4a12b6b6df21dfc5b4af" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46187 } } peers { permanent_uuid: "1dbdb919a3a54e28afc13ff2e89e5a49" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45769 } }
I20260809 18:51:01.477073 13137 leader_election.cc:288] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 552360ec9bfc4a12b6b6df21dfc5b4af (127.12.202.195:46187), 1dbdb919a3a54e28afc13ff2e89e5a49 (127.12.202.193:45769)
I20260809 18:51:01.478276 13136 raft_consensus.cc:348] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3c7c4f77a045a98bd646d73222de3d" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 42887 } } peers { permanent_uuid: "552360ec9bfc4a12b6b6df21dfc5b4af" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46187 } } peers { permanent_uuid: "1dbdb919a3a54e28afc13ff2e89e5a49" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45769 } }
I20260809 18:51:01.478437 13136 raft_consensus.cc:374] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:01.478472 13136 raft_consensus.cc:729] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 552360ec9bfc4a12b6b6df21dfc5b4af, State: Initialized, Role: FOLLOWER
I20260809 18:51:01.478598 13136 consensus_queue.cc:260] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3c7c4f77a045a98bd646d73222de3d" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 42887 } } peers { permanent_uuid: "552360ec9bfc4a12b6b6df21dfc5b4af" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46187 } } peers { permanent_uuid: "1dbdb919a3a54e28afc13ff2e89e5a49" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45769 } }
I20260809 18:51:01.478886 13136 ts_tablet_manager.cc:1428] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:51:01.478888 13093 heartbeater.cc:503] Master 127.12.202.254:42713 was elected leader, sending a full tablet report...
I20260809 18:51:01.480296 12888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.477212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:46187 (local address 127.12.202.194:56043)
0809 18:51:01.477248 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:01.477259 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:01.477295 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:01.477461 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:01.477463 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:01.477464 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:51:01.477523 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:01.477525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.478213 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.478214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:01.479258 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:01.479260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.480019 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.480020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:01.480103 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.480113 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 18:51:01.480188 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 18:51:01.480230 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17,"mutex_wait_us":3}
I20260809 18:51:01.480293 13122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.477264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:56043 (local address 127.12.202.195:46187)
0809 18:51:01.477303 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:01.477304 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:01.477315 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:51:01.477352 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:01.477353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:01.477361 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:01.477416 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:51:01.477585 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.478122 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.479348 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.479938 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.480022 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.480031 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:01.480197 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 18:51:01.480230 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 18:51:01.480558 13128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.477496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:55443 (local address 127.12.202.193:45769)
0809 18:51:01.477528 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:01.477530 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:01.477536 (+ 6us) server_negotiation.cc:407] Connection header received
0809 18:51:01.477555 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:01.477556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:01.477564 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:01.477610 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:51:01.477791 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.478459 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.479764 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.480175 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.480213 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.480219 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:01.480468 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 18:51:01.480502 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 18:51:01.480574 13141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.477308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:45769 (local address 127.12.202.194:55443)
0809 18:51:01.477424 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:01.477432 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:01.477473 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:01.477648 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:01.477648 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:01.477650 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:51:01.477711 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:01.477714 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.478557 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.478558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:01.479670 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:01.479673 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.480267 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.480268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:01.480368 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.480372 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:51:01.480459 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 18:51:01.480495 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":11,"thread_start_us":79,"threads_started":1}
I20260809 18:51:01.480954 12594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9aeba812d0124e3f95946406541e4633" candidate_uuid: "bf3c7c4f77a045a98bd646d73222de3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbdb919a3a54e28afc13ff2e89e5a49" is_pre_election: true
I20260809 18:51:01.480947 13024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9aeba812d0124e3f95946406541e4633" candidate_uuid: "bf3c7c4f77a045a98bd646d73222de3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "552360ec9bfc4a12b6b6df21dfc5b4af" is_pre_election: true
I20260809 18:51:01.481072 13024 raft_consensus.cc:2454] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf3c7c4f77a045a98bd646d73222de3d in term 0.
I20260809 18:51:01.481072 12594 raft_consensus.cc:2454] T 9aeba812d0124e3f95946406541e4633 P 1dbdb919a3a54e28afc13ff2e89e5a49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf3c7c4f77a045a98bd646d73222de3d in term 0.
I20260809 18:51:01.481272 12701 leader_election.cc:302] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dbdb919a3a54e28afc13ff2e89e5a49, bf3c7c4f77a045a98bd646d73222de3d; no voters:
I20260809 18:51:01.481429 13137 raft_consensus.cc:2781] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:51:01.481503 13137 raft_consensus.cc:482] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:51:01.481520 13137 raft_consensus.cc:3037] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:01.482282 13137 raft_consensus.cc:504] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3c7c4f77a045a98bd646d73222de3d" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 42887 } } peers { permanent_uuid: "552360ec9bfc4a12b6b6df21dfc5b4af" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46187 } } peers { permanent_uuid: "1dbdb919a3a54e28afc13ff2e89e5a49" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45769 } }
I20260809 18:51:01.482396 13137 leader_election.cc:288] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [CANDIDATE]: Term 1 election: Requested vote from peers 552360ec9bfc4a12b6b6df21dfc5b4af (127.12.202.195:46187), 1dbdb919a3a54e28afc13ff2e89e5a49 (127.12.202.193:45769)
I20260809 18:51:01.484869 12594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9aeba812d0124e3f95946406541e4633" candidate_uuid: "bf3c7c4f77a045a98bd646d73222de3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dbdb919a3a54e28afc13ff2e89e5a49"
I20260809 18:51:01.484961 12594 raft_consensus.cc:3037] T 9aeba812d0124e3f95946406541e4633 P 1dbdb919a3a54e28afc13ff2e89e5a49 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:01.484951 13024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9aeba812d0124e3f95946406541e4633" candidate_uuid: "bf3c7c4f77a045a98bd646d73222de3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "552360ec9bfc4a12b6b6df21dfc5b4af"
I20260809 18:51:01.485040 13024 raft_consensus.cc:3037] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:01.485918 12594 raft_consensus.cc:2454] T 9aeba812d0124e3f95946406541e4633 P 1dbdb919a3a54e28afc13ff2e89e5a49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf3c7c4f77a045a98bd646d73222de3d in term 1.
I20260809 18:51:01.486038 13024 raft_consensus.cc:2454] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf3c7c4f77a045a98bd646d73222de3d in term 1.
I20260809 18:51:01.486213 12701 leader_election.cc:302] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 552360ec9bfc4a12b6b6df21dfc5b4af, bf3c7c4f77a045a98bd646d73222de3d; no voters:
I20260809 18:51:01.486332 13137 raft_consensus.cc:2781] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:01.486518 13137 raft_consensus.cc:686] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [term 1 LEADER]: Becoming Leader. State: Replica: bf3c7c4f77a045a98bd646d73222de3d, State: Running, Role: LEADER
I20260809 18:51:01.486626 13137 consensus_queue.cc:237] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3c7c4f77a045a98bd646d73222de3d" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 42887 } } peers { permanent_uuid: "552360ec9bfc4a12b6b6df21dfc5b4af" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46187 } } peers { permanent_uuid: "1dbdb919a3a54e28afc13ff2e89e5a49" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45769 } }
I20260809 18:51:01.487406 12346 catalog_manager.cc:5495] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d reported cstate change: term changed from 0 to 1, leader changed from <none> to bf3c7c4f77a045a98bd646d73222de3d (127.12.202.194). New cstate: current_term: 1 leader_uuid: "bf3c7c4f77a045a98bd646d73222de3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf3c7c4f77a045a98bd646d73222de3d" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 42887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "552360ec9bfc4a12b6b6df21dfc5b4af" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dbdb919a3a54e28afc13ff2e89e5a49" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45769 } health_report { overall_health: UNKNOWN } } }
W20260809 18:51:01.490859 12883 tablet.cc:2369] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 18:51:01.497020 13125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.493994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42086 (local address 127.12.202.194:42887)
0809 18:51:01.494035 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:01.494037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:01.494046 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:51:01.494106 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:01.494107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:01.494127 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:01.494208 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:01.494373 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.495138 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.496251 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.496553 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.496606 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.496743 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:01.496831 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:01.496886 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:01.496935 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 18:51:01.496951 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 18:51:01.498665 12594 raft_consensus.cc:1261] T 9aeba812d0124e3f95946406541e4633 P 1dbdb919a3a54e28afc13ff2e89e5a49 [term 1 FOLLOWER]: Refusing update from remote peer bf3c7c4f77a045a98bd646d73222de3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:51:01.498831 13024 raft_consensus.cc:1261] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af [term 1 FOLLOWER]: Refusing update from remote peer bf3c7c4f77a045a98bd646d73222de3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:51:01.499017 13137 consensus_queue.cc:1035] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dbdb919a3a54e28afc13ff2e89e5a49" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 45769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:51:01.499154 13145 consensus_queue.cc:1035] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "552360ec9bfc4a12b6b6df21dfc5b4af" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:51:01.501574 13151 mvcc.cc:205] Tried to move back new op lower bound from 7316690786296033280 to 7316690786249961472. Current Snapshot: MvccSnapshot[applied={T|T < 7316690786296033280}]
I20260809 18:51:01.502276 13154 mvcc.cc:205] Tried to move back new op lower bound from 7316690786296033280 to 7316690786249961472. Current Snapshot: MvccSnapshot[applied={T|T < 7316690786296033280}]
I20260809 18:51:01.503707 12344 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47016:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:51:01.503827 12344 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47016:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:51:01.504585 12344 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3dd32a9b81fd445387da7b8026f55eb3: Sending DeleteTablet for 3 replicas of tablet 9aeba812d0124e3f95946406541e4633
I20260809 18:51:01.504951 12566 tablet_service.cc:1514] Processing DeleteTablet for tablet 9aeba812d0124e3f95946406541e4633 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:51:01 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:56450
I20260809 18:51:01.504958 12772 tablet_service.cc:1514] Processing DeleteTablet for tablet 9aeba812d0124e3f95946406541e4633 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:51:01 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:42084
I20260809 18:51:01.505175 12991 tablet_service.cc:1514] Processing DeleteTablet for tablet 9aeba812d0124e3f95946406541e4633 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:51:01 UTC) from {username='kudu', principal='kudu/127.12.202.254@KRBTEST.COM'} at 127.0.0.1:41980
I20260809 18:51:01.505425 13165 tablet_replica.cc:330] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af: stopping tablet replica
I20260809 18:51:01.505529 13165 raft_consensus.cc:2229] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:51:01.505611 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 12466
I20260809 18:51:01.505625 13165 raft_consensus.cc:2258] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:51:01.518911 13164 tablet_replica.cc:330] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d: stopping tablet replica
I20260809 18:51:01.519075 13164 raft_consensus.cc:2229] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:51:01.519222 13164 raft_consensus.cc:2258] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:51:01.519631 13165 ts_tablet_manager.cc:1905] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:51:01.519726 13164 ts_tablet_manager.cc:1905] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:51:01.521430 13165 ts_tablet_manager.cc:1918] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:51:01.521473 13164 ts_tablet_manager.cc:1918] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:51:01.521553 13164 log.cc:1196] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/9aeba812d0124e3f95946406541e4633
I20260809 18:51:01.521672 13165 log.cc:1196] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/9aeba812d0124e3f95946406541e4633
I20260809 18:51:01.521872 13164 ts_tablet_manager.cc:1939] T 9aeba812d0124e3f95946406541e4633 P bf3c7c4f77a045a98bd646d73222de3d: Deleting consensus metadata
I20260809 18:51:01.522118 13165 ts_tablet_manager.cc:1939] T 9aeba812d0124e3f95946406541e4633 P 552360ec9bfc4a12b6b6df21dfc5b4af: Deleting consensus metadata
I20260809 18:51:01.522338 12323 catalog_manager.cc:4841] TS bf3c7c4f77a045a98bd646d73222de3d (127.12.202.194:42887): tablet 9aeba812d0124e3f95946406541e4633 (table test-table [id=ceb69f1b153b41f18b43d75ed9dfc01a]) successfully deleted
I20260809 18:51:01.522686 12328 catalog_manager.cc:4841] TS 552360ec9bfc4a12b6b6df21dfc5b4af (127.12.202.195:46187): tablet 9aeba812d0124e3f95946406541e4633 (table test-table [id=ceb69f1b153b41f18b43d75ed9dfc01a]) successfully deleted
W20260809 18:51:01.525760 12328 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.202.193:45769 (error 108)
I20260809 18:51:01.526015 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 12671
I20260809 18:51:01.532037 13121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.526178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:45769 (local address 127.0.0.1:56464)
0809 18:51:01.531920 (+ 5742us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:01.531987 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:45769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5716}
W20260809 18:51:01.533176 12328 catalog_manager.cc:4584] TS 1dbdb919a3a54e28afc13ff2e89e5a49 (127.12.202.193:45769): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9aeba812d0124e3f95946406541e4633: Network error: Client connection negotiation failed: client connection to 127.12.202.193:45769: connect: Connection refused (error 111)
I20260809 18:51:01.543416 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 12892
I20260809 18:51:01.558247 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 12300
2026-08-09T18:51:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2226 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T18:51:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:01Z Disabled control of system clock
I20260809 18:51:01.595088 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:39243
--webserver_interface=127.12.202.254
--webserver_port=0
--builtin_ntp_servers=127.12.202.212:45187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:39243
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 18:51:01.677362 13172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:01.677587 13172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:01.677606 13172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:01.678800 13172 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:01.678843 13172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:01.678856 13172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:01.678943 13172 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:01.678966 13172 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:01.680372 13172 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:45187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:39243
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:39243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:01.680634 13172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:01.680938 13172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:01.685885 13181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:01.685959 13182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:01.685910 13186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:01.686380 13172 server_base.cc:1034] running on GCE node
I20260809 18:51:01.686652 13172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:01.686906 13172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:01.688046 13172 hybrid_clock.cc:648] HybridClock initialized: now 1786301461688032 us; error 29 us; skew 500 ppm
I20260809 18:51:01.689288 13172 webserver.cc:460] Webserver started at http://127.12.202.254:42595/ using document root <none> and password file <none>
I20260809 18:51:01.689486 13172 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:01.689527 13172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:01.689616 13172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:01.690627 13172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "126a7f52d177401693cbcaddcd89d333"
format_stamp: "Formatted at 2026-08-09 18:51:01 on dist-test-slave-45dx"
server_key: "1d6d61b38c6c5706358a7d762ec3b9b7"
server_key_iv: "cf3717a9b233cf4a1e8e12bdbfcd3961"
server_key_version: "encryptionkey@0"
I20260809 18:51:01.690949 13172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "126a7f52d177401693cbcaddcd89d333"
format_stamp: "Formatted at 2026-08-09 18:51:01 on dist-test-slave-45dx"
server_key: "1d6d61b38c6c5706358a7d762ec3b9b7"
server_key_iv: "cf3717a9b233cf4a1e8e12bdbfcd3961"
server_key_version: "encryptionkey@0"
I20260809 18:51:01.692165 13172 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:51:01.693029 13195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:01.693226 13172 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:51:01.693341 13172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "126a7f52d177401693cbcaddcd89d333"
format_stamp: "Formatted at 2026-08-09 18:51:01 on dist-test-slave-45dx"
server_key: "1d6d61b38c6c5706358a7d762ec3b9b7"
server_key_iv: "cf3717a9b233cf4a1e8e12bdbfcd3961"
server_key_version: "encryptionkey@0"
I20260809 18:51:01.693419 13172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:01.712682 13172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:01.713052 13172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:01.713227 13172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:01.717459 13172 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:39243
I20260809 18:51:01.717496 13273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:39243 every 8 connection(s)
I20260809 18:51:01.717846 13172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:01.718902 13275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:01.719671 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 13172
I20260809 18:51:01.719805 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:01.720009 13099 external_mini_cluster.cc:1428] Setting key 37474b99a6467d2c1fa0575c04e9939d
I20260809 18:51:01.722093 13275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333: Bootstrap starting.
I20260809 18:51:01.722729 13275 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:01.723062 13275 log.cc:824] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:01.723771 13275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333: No bootstrap required, opened a new log
I20260809 18:51:01.725580 13275 raft_consensus.cc:348] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "126a7f52d177401693cbcaddcd89d333" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39243 } }
I20260809 18:51:01.725709 13275 raft_consensus.cc:374] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:01.725731 13275 raft_consensus.cc:729] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 126a7f52d177401693cbcaddcd89d333, State: Initialized, Role: FOLLOWER
I20260809 18:51:01.725750 13279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.720592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38484 (local address 127.12.202.254:39243)
0809 18:51:01.720784 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:01.720790 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:01.720817 (+ 27us) server_negotiation.cc:407] Connection header received
0809 18:51:01.721235 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:01.721241 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:01.721299 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:01.721417 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:01.721660 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.722593 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.723612 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.724047 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.724139 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.724830 (+ 691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:01.724833 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:01.724834 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:01.725026 (+ 192us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:01.725058 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:01.725067 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:01.725116 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:01.725216 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 18:51:01.725297 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
I20260809 18:51:01.726086 13275 consensus_queue.cc:260] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "126a7f52d177401693cbcaddcd89d333" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39243 } }
I20260809 18:51:01.726177 13275 raft_consensus.cc:388] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:01.726198 13275 raft_consensus.cc:482] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:01.726263 13275 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:01.726826 13275 raft_consensus.cc:504] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "126a7f52d177401693cbcaddcd89d333" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39243 } }
I20260809 18:51:01.726922 13275 leader_election.cc:302] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 126a7f52d177401693cbcaddcd89d333; no voters:
I20260809 18:51:01.727047 13275 leader_election.cc:288] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:01.727130 13284 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:01.727267 13284 raft_consensus.cc:686] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333 [term 1 LEADER]: Becoming Leader. State: Replica: 126a7f52d177401693cbcaddcd89d333, State: Running, Role: LEADER
I20260809 18:51:01.727353 13275 sys_catalog.cc:564] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:01.727349 13284 consensus_queue.cc:237] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "126a7f52d177401693cbcaddcd89d333" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39243 } }
I20260809 18:51:01.727831 13285 sys_catalog.cc:455] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "126a7f52d177401693cbcaddcd89d333" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "126a7f52d177401693cbcaddcd89d333" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39243 } } }
I20260809 18:51:01.727931 13285 sys_catalog.cc:458] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:01.728103 13289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 126a7f52d177401693cbcaddcd89d333. Latest consensus state: current_term: 1 leader_uuid: "126a7f52d177401693cbcaddcd89d333" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "126a7f52d177401693cbcaddcd89d333" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39243 } } }
I20260809 18:51:01.728174 13289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:01.728354 13296 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:01.728834 13296 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:01.730324 13296 catalog_manager.cc:1347] Generated new cluster ID: e46b6946ab434075b8df1a30ff5e923a
I20260809 18:51:01.730398 13296 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:51:01.749956 13296 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:01.750530 13296 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:01.753340 13296 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333: Generated new TSK 0
I20260809 18:51:01.753517 13296 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:01.755271 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.193:0
--local_ip_for_outbound_sockets=127.12.202.193
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39243
--builtin_ntp_servers=127.12.202.212:45187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 18:51:01.874969 13315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:01.875324 13315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:01.875358 13315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:01.877225 13315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:01.877298 13315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:01.877339 13315 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.193
I20260809 18:51:01.879292 13315 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:45187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.202.193
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.193
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:01.879556 13315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:01.879966 13315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:01.885368 13321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:01.885391 13320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:01.885627 13315 server_base.cc:1034] running on GCE node
W20260809 18:51:01.885811 13323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:01.886041 13315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:01.886327 13315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:01.887499 13315 hybrid_clock.cc:648] HybridClock initialized: now 1786301461887478 us; error 37 us; skew 500 ppm
I20260809 18:51:01.889042 13315 webserver.cc:460] Webserver started at http://127.12.202.193:38989/ using document root <none> and password file <none>
I20260809 18:51:01.889336 13315 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:01.889386 13315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:01.889551 13315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:01.890714 13315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-0/data/instance:
uuid: "6d7a80d5bcfe42e7a74c5afc9efd83c9"
format_stamp: "Formatted at 2026-08-09 18:51:01 on dist-test-slave-45dx"
server_key: "e2d06eeca4f4b84b08cf88759e1451e5"
server_key_iv: "0b0c517faf03952f16dd5f3a3dd96fea"
server_key_version: "encryptionkey@0"
I20260809 18:51:01.891132 13315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance:
uuid: "6d7a80d5bcfe42e7a74c5afc9efd83c9"
format_stamp: "Formatted at 2026-08-09 18:51:01 on dist-test-slave-45dx"
server_key: "e2d06eeca4f4b84b08cf88759e1451e5"
server_key_iv: "0b0c517faf03952f16dd5f3a3dd96fea"
server_key_version: "encryptionkey@0"
I20260809 18:51:01.892591 13315 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 18:51:01.893431 13337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:01.893611 13315 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:51:01.893721 13315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-0/wal
uuid: "6d7a80d5bcfe42e7a74c5afc9efd83c9"
format_stamp: "Formatted at 2026-08-09 18:51:01 on dist-test-slave-45dx"
server_key: "e2d06eeca4f4b84b08cf88759e1451e5"
server_key_iv: "0b0c517faf03952f16dd5f3a3dd96fea"
server_key_version: "encryptionkey@0"
I20260809 18:51:01.893796 13315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:01.906220 13315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:01.906533 13315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:01.906678 13315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:01.906898 13315 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:51:01.907223 13315 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:51:01.907287 13315 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:01.907328 13315 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:51:01.907356 13315 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:01.913168 13315 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.193:40843
I20260809 18:51:01.913244 13514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.193:40843 every 8 connection(s)
I20260809 18:51:01.913582 13315 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-0/data/info.pb
I20260809 18:51:01.918812 13279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.914339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.193:40523 (local address 127.12.202.254:39243)
0809 18:51:01.914387 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:01.914389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:01.914584 (+ 195us) server_negotiation.cc:407] Connection header received
0809 18:51:01.915146 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:01.915148 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:01.915164 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:01.915218 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:01.915886 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.916390 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.917396 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.917591 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.917667 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.918510 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:01.918512 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:01.918512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:01.918517 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:01.918532 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:01.918536 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:01.918597 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:01.918702 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 18:51:01.918734 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:51:01.919014 13518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:01.914295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:39243 (local address 127.12.202.193:40523)
0809 18:51:01.914456 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:01.914497 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:01.915038 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:01.915295 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:01.915299 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:01.915308 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:01.915784 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:01.915789 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.916491 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.916492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:01.917278 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:01.917280 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:01.917676 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:01.917678 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:01.917814 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:01.918369 (+ 555us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:51:01.918369 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:01.918395 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:51:01.918417 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:01.918608 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:01.918615 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:01.918618 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:51:01.918703 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 18:51:01.918799 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":60,"threads_started":1}
I20260809 18:51:01.919526 13515 heartbeater.cc:347] Connected to a master server at 127.12.202.254:39243
I20260809 18:51:01.919600 13515 heartbeater.cc:464] Registering TS with master...
I20260809 18:51:01.919811 13515 heartbeater.cc:511] Master 127.12.202.254:39243 requested a full tablet report, sending...
I20260809 18:51:01.920362 13226 ts_manager.cc:194] Registered new tserver with Master: 6d7a80d5bcfe42e7a74c5afc9efd83c9 (127.12.202.193:40843)
I20260809 18:51:01.920985 13226 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.202.193:40523
I20260809 18:51:01.921936 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 13315
I20260809 18:51:01.922066 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-0/wal/instance
I20260809 18:51:01.922276 13099 external_mini_cluster.cc:1428] Setting key c8fa44c68ede926122e5a25fb43e7bcf
I20260809 18:51:01.923116 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.194:0
--local_ip_for_outbound_sockets=127.12.202.194
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39243
--builtin_ntp_servers=127.12.202.212:45187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 18:51:02.006036 13519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:02.006299 13519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:02.006347 13519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:02.007522 13519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:02.007586 13519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:02.007627 13519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.194
I20260809 18:51:02.009059 13519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:45187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.202.194
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.194
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:02.009318 13519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:02.009620 13519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:02.014793 13524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:02.014809 13528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:02.014801 13526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:02.015017 13519 server_base.cc:1034] running on GCE node
I20260809 18:51:02.015297 13519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:02.015563 13519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:02.016706 13519 hybrid_clock.cc:648] HybridClock initialized: now 1786301462016685 us; error 37 us; skew 500 ppm
I20260809 18:51:02.018004 13519 webserver.cc:460] Webserver started at http://127.12.202.194:43213/ using document root <none> and password file <none>
I20260809 18:51:02.018258 13519 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:02.018304 13519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:02.018499 13519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:02.019606 13519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-1/data/instance:
uuid: "2c73a8a3f935496eac4d4ec6846e15d9"
format_stamp: "Formatted at 2026-08-09 18:51:02 on dist-test-slave-45dx"
server_key: "eabdd4a5bab4ca406d231f5c6645c4ab"
server_key_iv: "e561f872280b07c3ef72855bc6d6c616"
server_key_version: "encryptionkey@0"
I20260809 18:51:02.019966 13519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance:
uuid: "2c73a8a3f935496eac4d4ec6846e15d9"
format_stamp: "Formatted at 2026-08-09 18:51:02 on dist-test-slave-45dx"
server_key: "eabdd4a5bab4ca406d231f5c6645c4ab"
server_key_iv: "e561f872280b07c3ef72855bc6d6c616"
server_key_version: "encryptionkey@0"
I20260809 18:51:02.021399 13519 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:51:02.022152 13538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:02.022357 13519 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:51:02.022449 13519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-1/wal
uuid: "2c73a8a3f935496eac4d4ec6846e15d9"
format_stamp: "Formatted at 2026-08-09 18:51:02 on dist-test-slave-45dx"
server_key: "eabdd4a5bab4ca406d231f5c6645c4ab"
server_key_iv: "e561f872280b07c3ef72855bc6d6c616"
server_key_version: "encryptionkey@0"
I20260809 18:51:02.022506 13519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:02.034868 13519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:02.035107 13519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:02.035208 13519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:02.035405 13519 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:51:02.035750 13519 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:51:02.035789 13519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:02.035846 13519 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:51:02.035873 13519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:02.042158 13519 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.194:36353
I20260809 18:51:02.042213 13717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.194:36353 every 8 connection(s)
I20260809 18:51:02.042533 13519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-1/data/info.pb
I20260809 18:51:02.047648 13279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:02.043322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:42371 (local address 127.12.202.254:39243)
0809 18:51:02.043391 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:02.043393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:02.043589 (+ 196us) server_negotiation.cc:407] Connection header received
0809 18:51:02.044059 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:02.044060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:02.044070 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:02.044132 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:02.044883 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.045366 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.046316 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.046503 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.046552 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:02.047421 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:02.047422 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:02.047422 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:02.047426 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:02.047437 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:02.047441 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:02.047479 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:02.047564 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 18:51:02.047588 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 18:51:02.047828 13721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:02.043273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:39243 (local address 127.12.202.194:42371)
0809 18:51:02.043462 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:02.043503 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:02.043979 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:02.044198 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:02.044201 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:02.044209 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:02.044798 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:02.044803 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.045461 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.045461 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:02.046236 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:02.046239 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.046584 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.046585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:02.046693 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:02.047275 (+ 582us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:51:02.047276 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:02.047306 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:51:02.047328 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:02.047495 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:02.047500 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:02.047502 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:51:02.047551 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 18:51:02.047630 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
I20260809 18:51:02.048419 13718 heartbeater.cc:347] Connected to a master server at 127.12.202.254:39243
I20260809 18:51:02.048537 13718 heartbeater.cc:464] Registering TS with master...
I20260809 18:51:02.048727 13718 heartbeater.cc:511] Master 127.12.202.254:39243 requested a full tablet report, sending...
I20260809 18:51:02.048987 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 13519
I20260809 18:51:02.049129 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-1/wal/instance
I20260809 18:51:02.049167 13226 ts_manager.cc:194] Registered new tserver with Master: 2c73a8a3f935496eac4d4ec6846e15d9 (127.12.202.194:36353)
I20260809 18:51:02.049372 13099 external_mini_cluster.cc:1428] Setting key c097fe8f909ee06a470935764c6fee81
I20260809 18:51:02.049638 13226 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.202.194:42371
I20260809 18:51:02.050562 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.202.195:0
--local_ip_for_outbound_sockets=127.12.202.195
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39243
--builtin_ntp_servers=127.12.202.212:45187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 18:51:02.134229 13728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:02.134434 13728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:02.134456 13728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:02.135560 13728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:02.135600 13728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:02.135624 13728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.202.195
I20260809 18:51:02.136890 13728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:45187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.202.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.202.195
--webserver_port=0
--tserver_master_addrs=127.12.202.254:39243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.202.195
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:02.137116 13728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:02.137389 13728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:02.142379 13737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:02.142436 13734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:02.142400 13735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:02.142630 13728 server_base.cc:1034] running on GCE node
I20260809 18:51:02.142879 13728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:02.143151 13728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:02.144352 13728 hybrid_clock.cc:648] HybridClock initialized: now 1786301462144329 us; error 32 us; skew 500 ppm
I20260809 18:51:02.145583 13728 webserver.cc:460] Webserver started at http://127.12.202.195:34359/ using document root <none> and password file <none>
I20260809 18:51:02.145826 13728 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:02.145895 13728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:02.146037 13728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:02.147051 13728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-2/data/instance:
uuid: "d1d6f2a5dac64a41b7ded9e494c0c1a4"
format_stamp: "Formatted at 2026-08-09 18:51:02 on dist-test-slave-45dx"
server_key: "14616715e590ee694834a821b317f7e8"
server_key_iv: "b8007ec8a8f08374cd17199e7038117f"
server_key_version: "encryptionkey@0"
I20260809 18:51:02.147423 13728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance:
uuid: "d1d6f2a5dac64a41b7ded9e494c0c1a4"
format_stamp: "Formatted at 2026-08-09 18:51:02 on dist-test-slave-45dx"
server_key: "14616715e590ee694834a821b317f7e8"
server_key_iv: "b8007ec8a8f08374cd17199e7038117f"
server_key_version: "encryptionkey@0"
I20260809 18:51:02.148752 13728 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:51:02.149474 13746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:02.149636 13728 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:51:02.149741 13728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-2/wal
uuid: "d1d6f2a5dac64a41b7ded9e494c0c1a4"
format_stamp: "Formatted at 2026-08-09 18:51:02 on dist-test-slave-45dx"
server_key: "14616715e590ee694834a821b317f7e8"
server_key_iv: "b8007ec8a8f08374cd17199e7038117f"
server_key_version: "encryptionkey@0"
I20260809 18:51:02.149819 13728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:02.160422 13728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:02.160692 13728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:02.160842 13728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:02.161063 13728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 18:51:02.161386 13728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 18:51:02.161453 13728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:02.161495 13728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 18:51:02.161520 13728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:02.167605 13728 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.195:46699
I20260809 18:51:02.167642 13928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.195:46699 every 8 connection(s)
I20260809 18:51:02.167975 13728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-2/data/info.pb
I20260809 18:51:02.172883 13279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:02.168728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.195:38461 (local address 127.12.202.254:39243)
0809 18:51:02.168770 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:02.168772 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:02.169009 (+ 237us) server_negotiation.cc:407] Connection header received
0809 18:51:02.169462 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:02.169463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:02.169474 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:02.169526 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:02.170174 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.170673 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.171602 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.171791 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.171845 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:02.172664 (+ 819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:02.172665 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:02.172665 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:02.172670 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:02.172685 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:02.172689 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:02.172732 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:02.172801 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 18:51:02.172823 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 18:51:02.173087 13931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:02.168705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:39243 (local address 127.12.202.195:38461)
0809 18:51:02.168879 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:02.168912 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:02.169371 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:02.169576 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:02.169579 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:02.169586 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:02.170089 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:02.170092 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.170756 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.170757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:02.171523 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:02.171525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.171877 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.171878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:02.171979 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:02.172531 (+ 552us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 18:51:02.172532 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:02.172559 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 18:51:02.172581 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:02.172737 (+ 156us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:02.172739 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:02.172741 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 18:51:02.172785 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 18:51:02.172854 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":82,"threads_started":1}
I20260809 18:51:02.173653 13929 heartbeater.cc:347] Connected to a master server at 127.12.202.254:39243
I20260809 18:51:02.173768 13929 heartbeater.cc:464] Registering TS with master...
I20260809 18:51:02.173918 13929 heartbeater.cc:511] Master 127.12.202.254:39243 requested a full tablet report, sending...
I20260809 18:51:02.174284 13225 ts_manager.cc:194] Registered new tserver with Master: d1d6f2a5dac64a41b7ded9e494c0c1a4 (127.12.202.195:46699)
I20260809 18:51:02.174649 13225 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.202.195:38461
I20260809 18:51:02.176411 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 13728
I20260809 18:51:02.176538 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-2/wal/instance
I20260809 18:51:02.176753 13099 external_mini_cluster.cc:1428] Setting key 3e4b4d3fcfbac443621e820b993dddc2
I20260809 18:51:02.177728 13099 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 18:51:02.182117 13279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:02.179402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38496 (local address 127.12.202.254:39243)
0809 18:51:02.179491 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:02.179493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:02.179604 (+ 111us) server_negotiation.cc:407] Connection header received
0809 18:51:02.179640 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:02.179641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:02.179650 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:02.179704 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:02.179845 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.180352 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.181042 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.181221 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.181273 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:02.181924 (+ 651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:02.181925 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:02.181926 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:02.181930 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:02.181944 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:02.181948 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:02.181991 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:02.182041 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 18:51:02.182061 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 18:51:02.183874 13225 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38496:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 18:51:02.185487 13225 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 18:51:02.191798 13942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:02.187705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:40843 (local address 127.0.0.1:36024)
0809 18:51:02.187906 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:02.187948 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:02.188010 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:02.188649 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:02.188650 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:02.188652 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:51:02.188702 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:02.188703 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.189587 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.189588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:02.190621 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:02.190623 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.191502 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.191503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:02.191586 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:02.191600 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 18:51:02.191674 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 18:51:02.191719 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":2,"thread_start_us":75,"threads_started":1}
I20260809 18:51:02.191838 13945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:02.187814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36024 (local address 127.12.202.193:40843)
0809 18:51:02.188421 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:02.188426 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:02.188437 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:51:02.188480 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:02.188482 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:02.188499 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:02.188573 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:51:02.188781 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.189490 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.190713 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.191401 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.191484 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:02.191574 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:02.191706 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 18:51:02.191745 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":100,"threads_started":1}
I20260809 18:51:02.192085 13943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:02.187705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:46699 (local address 127.0.0.1:45210)
0809 18:51:02.187943 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:02.187955 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:02.188017 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:02.188535 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:02.188537 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:02.188539 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:51:02.188606 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:02.188608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.189481 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.189482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:02.190845 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:02.190849 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.191843 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.191844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:02.191910 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:02.191914 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 18:51:02.191974 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 18:51:02.192015 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"mutex_wait_us":71,"thread_start_us":76,"threads_started":1}
I20260809 18:51:02.192113 13951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:02.188096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45210 (local address 127.12.202.195:46699)
0809 18:51:02.188252 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:02.188255 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:02.188263 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:51:02.188347 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:02.188349 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:02.188365 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:02.188446 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:51:02.188686 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.189392 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.190936 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.191655 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.191725 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:02.191803 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:02.191989 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 18:51:02.192031 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
I20260809 18:51:02.192651 13406 tablet_service.cc:1467] Processing CreateTablet for tablet c9799b7604e14c46bd41c2307fcc9f8c (DEFAULT_TABLE table=test-table [id=15479e22b9f6413c8a8b7b5a69f81977]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:51:02.192813 13830 tablet_service.cc:1467] Processing CreateTablet for tablet c9799b7604e14c46bd41c2307fcc9f8c (DEFAULT_TABLE table=test-table [id=15479e22b9f6413c8a8b7b5a69f81977]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:51:02.193066 13406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9799b7604e14c46bd41c2307fcc9f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:02.193226 13830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9799b7604e14c46bd41c2307fcc9f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:02.193640 13946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:02.187936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.194:36353 (local address 127.0.0.1:35104)
0809 18:51:02.188080 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:02.188088 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:02.188125 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:02.189725 (+ 1600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:02.189725 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:02.189728 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:51:02.189761 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:02.189762 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.190999 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.191000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:02.191853 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:02.191856 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.193422 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.193423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:02.193492 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:02.193498 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 18:51:02.193531 (+ 33us) client_negotiation.cc:240] Negotiation successful
0809 18:51:02.193570 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":2,"thread_start_us":90,"threads_started":1}
I20260809 18:51:02.194087 13957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:02.188369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35104 (local address 127.12.202.194:36353)
0809 18:51:02.189567 (+ 1198us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:02.189571 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:02.189581 (+ 10us) server_negotiation.cc:407] Connection header received
0809 18:51:02.189618 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:02.189620 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:02.189635 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:02.189714 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:51:02.189821 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.190908 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.192392 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.193315 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.193839 (+ 524us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:02.193938 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:02.193965 (+ 27us) server_negotiation.cc:299] Negotiation successful
0809 18:51:02.194006 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1158,"thread_start_us":96,"threads_started":1}
I20260809 18:51:02.194775 13621 tablet_service.cc:1467] Processing CreateTablet for tablet c9799b7604e14c46bd41c2307fcc9f8c (DEFAULT_TABLE table=test-table [id=15479e22b9f6413c8a8b7b5a69f81977]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 18:51:02.195166 13621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9799b7604e14c46bd41c2307fcc9f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:02.196647 13958 tablet_bootstrap.cc:492] T c9799b7604e14c46bd41c2307fcc9f8c P 6d7a80d5bcfe42e7a74c5afc9efd83c9: Bootstrap starting.
I20260809 18:51:02.196992 13959 tablet_bootstrap.cc:492] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4: Bootstrap starting.
I20260809 18:51:02.197502 13958 tablet_bootstrap.cc:654] T c9799b7604e14c46bd41c2307fcc9f8c P 6d7a80d5bcfe42e7a74c5afc9efd83c9: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:02.197664 13959 tablet_bootstrap.cc:654] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:02.197897 13958 log.cc:824] T c9799b7604e14c46bd41c2307fcc9f8c P 6d7a80d5bcfe42e7a74c5afc9efd83c9: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:02.197990 13959 log.cc:824] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:02.198663 13958 tablet_bootstrap.cc:492] T c9799b7604e14c46bd41c2307fcc9f8c P 6d7a80d5bcfe42e7a74c5afc9efd83c9: No bootstrap required, opened a new log
I20260809 18:51:02.198763 13958 ts_tablet_manager.cc:1397] T c9799b7604e14c46bd41c2307fcc9f8c P 6d7a80d5bcfe42e7a74c5afc9efd83c9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 18:51:02.198778 13959 tablet_bootstrap.cc:492] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4: No bootstrap required, opened a new log
I20260809 18:51:02.198844 13959 ts_tablet_manager.cc:1397] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:51:02.199189 13963 tablet_bootstrap.cc:492] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9: Bootstrap starting.
I20260809 18:51:02.199913 13963 tablet_bootstrap.cc:654] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:02.200228 13963 log.cc:824] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:02.200924 13959 raft_consensus.cc:348] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d6f2a5dac64a41b7ded9e494c0c1a4" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46699 } } peers { permanent_uuid: "6d7a80d5bcfe42e7a74c5afc9efd83c9" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 40843 } } peers { permanent_uuid: "2c73a8a3f935496eac4d4ec6846e15d9" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36353 } }
I20260809 18:51:02.201048 13959 raft_consensus.cc:374] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:02.201053 13963 tablet_bootstrap.cc:492] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9: No bootstrap required, opened a new log
I20260809 18:51:02.201068 13959 raft_consensus.cc:729] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1d6f2a5dac64a41b7ded9e494c0c1a4, State: Initialized, Role: FOLLOWER
I20260809 18:51:02.201113 13963 ts_tablet_manager.cc:1397] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 18:51:02.201188 13959 consensus_queue.cc:260] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d6f2a5dac64a41b7ded9e494c0c1a4" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46699 } } peers { permanent_uuid: "6d7a80d5bcfe42e7a74c5afc9efd83c9" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 40843 } } peers { permanent_uuid: "2c73a8a3f935496eac4d4ec6846e15d9" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36353 } }
I20260809 18:51:02.201463 13959 ts_tablet_manager.cc:1428] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 18:51:02.201499 13929 heartbeater.cc:503] Master 127.12.202.254:39243 was elected leader, sending a full tablet report...
I20260809 18:51:02.202172 13958 raft_consensus.cc:348] T c9799b7604e14c46bd41c2307fcc9f8c P 6d7a80d5bcfe42e7a74c5afc9efd83c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d6f2a5dac64a41b7ded9e494c0c1a4" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46699 } } peers { permanent_uuid: "6d7a80d5bcfe42e7a74c5afc9efd83c9" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 40843 } } peers { permanent_uuid: "2c73a8a3f935496eac4d4ec6846e15d9" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36353 } }
I20260809 18:51:02.202343 13958 raft_consensus.cc:374] T c9799b7604e14c46bd41c2307fcc9f8c P 6d7a80d5bcfe42e7a74c5afc9efd83c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:02.202389 13958 raft_consensus.cc:729] T c9799b7604e14c46bd41c2307fcc9f8c P 6d7a80d5bcfe42e7a74c5afc9efd83c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d7a80d5bcfe42e7a74c5afc9efd83c9, State: Initialized, Role: FOLLOWER
I20260809 18:51:02.202497 13958 consensus_queue.cc:260] T c9799b7604e14c46bd41c2307fcc9f8c P 6d7a80d5bcfe42e7a74c5afc9efd83c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d6f2a5dac64a41b7ded9e494c0c1a4" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46699 } } peers { permanent_uuid: "6d7a80d5bcfe42e7a74c5afc9efd83c9" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 40843 } } peers { permanent_uuid: "2c73a8a3f935496eac4d4ec6846e15d9" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36353 } }
I20260809 18:51:02.202768 13958 ts_tablet_manager.cc:1428] T c9799b7604e14c46bd41c2307fcc9f8c P 6d7a80d5bcfe42e7a74c5afc9efd83c9: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260809 18:51:02.202925 13515 heartbeater.cc:503] Master 127.12.202.254:39243 was elected leader, sending a full tablet report...
I20260809 18:51:02.203724 13963 raft_consensus.cc:348] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d6f2a5dac64a41b7ded9e494c0c1a4" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46699 } } peers { permanent_uuid: "6d7a80d5bcfe42e7a74c5afc9efd83c9" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 40843 } } peers { permanent_uuid: "2c73a8a3f935496eac4d4ec6846e15d9" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36353 } }
I20260809 18:51:02.203850 13963 raft_consensus.cc:374] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:02.203871 13963 raft_consensus.cc:729] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c73a8a3f935496eac4d4ec6846e15d9, State: Initialized, Role: FOLLOWER
I20260809 18:51:02.203979 13963 consensus_queue.cc:260] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d6f2a5dac64a41b7ded9e494c0c1a4" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46699 } } peers { permanent_uuid: "6d7a80d5bcfe42e7a74c5afc9efd83c9" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 40843 } } peers { permanent_uuid: "2c73a8a3f935496eac4d4ec6846e15d9" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36353 } }
I20260809 18:51:02.204191 13963 ts_tablet_manager.cc:1428] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 18:51:02.204278 13718 heartbeater.cc:503] Master 127.12.202.254:39243 was elected leader, sending a full tablet report...
I20260809 18:51:02.236620 13970 raft_consensus.cc:482] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 18:51:02.236788 13970 raft_consensus.cc:504] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d6f2a5dac64a41b7ded9e494c0c1a4" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46699 } } peers { permanent_uuid: "6d7a80d5bcfe42e7a74c5afc9efd83c9" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 40843 } } peers { permanent_uuid: "2c73a8a3f935496eac4d4ec6846e15d9" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36353 } }
I20260809 18:51:02.237205 13970 leader_election.cc:288] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1d6f2a5dac64a41b7ded9e494c0c1a4 (127.12.202.195:46699), 6d7a80d5bcfe42e7a74c5afc9efd83c9 (127.12.202.193:40843)
I20260809 18:51:02.240015 13951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:02.237475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:40317 (local address 127.12.202.195:46699)
0809 18:51:02.237529 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:02.237531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:02.237540 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:51:02.237620 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:02.237621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:02.237637 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:02.237699 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:51:02.237861 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.238340 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.239274 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.239645 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.239730 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:02.239739 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:02.239901 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 18:51:02.239942 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 18:51:02.240041 13721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:02.237368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.195:46699 (local address 127.12.202.194:40317)
0809 18:51:02.237465 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:02.237478 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:02.237528 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:02.237702 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:02.237703 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:02.237705 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:51:02.237781 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:02.237783 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.238433 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.238434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:02.239154 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:02.239156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.239729 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.239730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:02.239806 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:02.239809 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:51:02.239892 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 18:51:02.239934 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260809 18:51:02.240064 13945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:02.237486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.202.194:56081 (local address 127.12.202.193:40843)
0809 18:51:02.237552 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:02.237554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:02.237632 (+ 78us) server_negotiation.cc:407] Connection header received
0809 18:51:02.237701 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:02.237702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:02.237721 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:02.237788 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 18:51:02.237962 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.238409 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.239324 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.239689 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.239778 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:02.239785 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:02.239944 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 18:51:02.239985 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:51:02.240149 13972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:02.237394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:40843 (local address 127.12.202.194:56081)
0809 18:51:02.237554 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:02.237565 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:02.237648 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:02.237792 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:02.237793 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:02.237794 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 18:51:02.237888 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:02.237889 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.238492 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.238493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:02.239205 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:02.239207 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.239778 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.239779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:02.239868 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:02.239871 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 18:51:02.239938 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 18:51:02.239978 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":94,"threads_started":1}
I20260809 18:51:02.240430 13445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9799b7604e14c46bd41c2307fcc9f8c" candidate_uuid: "2c73a8a3f935496eac4d4ec6846e15d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d7a80d5bcfe42e7a74c5afc9efd83c9" is_pre_election: true
I20260809 18:51:02.240437 13858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9799b7604e14c46bd41c2307fcc9f8c" candidate_uuid: "2c73a8a3f935496eac4d4ec6846e15d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d6f2a5dac64a41b7ded9e494c0c1a4" is_pre_election: true
I20260809 18:51:02.240587 13858 raft_consensus.cc:2454] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c73a8a3f935496eac4d4ec6846e15d9 in term 0.
I20260809 18:51:02.240594 13445 raft_consensus.cc:2454] T c9799b7604e14c46bd41c2307fcc9f8c P 6d7a80d5bcfe42e7a74c5afc9efd83c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c73a8a3f935496eac4d4ec6846e15d9 in term 0.
I20260809 18:51:02.240824 13548 leader_election.cc:302] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c73a8a3f935496eac4d4ec6846e15d9, 6d7a80d5bcfe42e7a74c5afc9efd83c9; no voters:
I20260809 18:51:02.240984 13970 raft_consensus.cc:2781] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 18:51:02.241052 13970 raft_consensus.cc:482] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 18:51:02.241075 13970 raft_consensus.cc:3037] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:02.241788 13970 raft_consensus.cc:504] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d6f2a5dac64a41b7ded9e494c0c1a4" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46699 } } peers { permanent_uuid: "6d7a80d5bcfe42e7a74c5afc9efd83c9" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 40843 } } peers { permanent_uuid: "2c73a8a3f935496eac4d4ec6846e15d9" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36353 } }
I20260809 18:51:02.241940 13970 leader_election.cc:288] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [CANDIDATE]: Term 1 election: Requested vote from peers d1d6f2a5dac64a41b7ded9e494c0c1a4 (127.12.202.195:46699), 6d7a80d5bcfe42e7a74c5afc9efd83c9 (127.12.202.193:40843)
I20260809 18:51:02.242100 13858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9799b7604e14c46bd41c2307fcc9f8c" candidate_uuid: "2c73a8a3f935496eac4d4ec6846e15d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1d6f2a5dac64a41b7ded9e494c0c1a4"
I20260809 18:51:02.242136 13445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9799b7604e14c46bd41c2307fcc9f8c" candidate_uuid: "2c73a8a3f935496eac4d4ec6846e15d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d7a80d5bcfe42e7a74c5afc9efd83c9"
I20260809 18:51:02.242188 13858 raft_consensus.cc:3037] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:02.242209 13445 raft_consensus.cc:3037] T c9799b7604e14c46bd41c2307fcc9f8c P 6d7a80d5bcfe42e7a74c5afc9efd83c9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:02.243136 13445 raft_consensus.cc:2454] T c9799b7604e14c46bd41c2307fcc9f8c P 6d7a80d5bcfe42e7a74c5afc9efd83c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c73a8a3f935496eac4d4ec6846e15d9 in term 1.
I20260809 18:51:02.243136 13858 raft_consensus.cc:2454] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c73a8a3f935496eac4d4ec6846e15d9 in term 1.
I20260809 18:51:02.243290 13548 leader_election.cc:302] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c73a8a3f935496eac4d4ec6846e15d9, 6d7a80d5bcfe42e7a74c5afc9efd83c9; no voters:
I20260809 18:51:02.243382 13970 raft_consensus.cc:2781] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:02.243532 13970 raft_consensus.cc:686] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [term 1 LEADER]: Becoming Leader. State: Replica: 2c73a8a3f935496eac4d4ec6846e15d9, State: Running, Role: LEADER
I20260809 18:51:02.243643 13970 consensus_queue.cc:237] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d6f2a5dac64a41b7ded9e494c0c1a4" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46699 } } peers { permanent_uuid: "6d7a80d5bcfe42e7a74c5afc9efd83c9" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 40843 } } peers { permanent_uuid: "2c73a8a3f935496eac4d4ec6846e15d9" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36353 } }
I20260809 18:51:02.244563 13226 catalog_manager.cc:5495] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c73a8a3f935496eac4d4ec6846e15d9 (127.12.202.194). New cstate: current_term: 1 leader_uuid: "2c73a8a3f935496eac4d4ec6846e15d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1d6f2a5dac64a41b7ded9e494c0c1a4" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d7a80d5bcfe42e7a74c5afc9efd83c9" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 40843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c73a8a3f935496eac4d4ec6846e15d9" member_type: VOTER last_known_addr { host: "127.12.202.194" port: 36353 } health_report { overall_health: HEALTHY } } }
I20260809 18:51:02.249481 13957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:02.247169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52708 (local address 127.12.202.194:36353)
0809 18:51:02.247228 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:02.247230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:02.247254 (+ 24us) server_negotiation.cc:407] Connection header received
0809 18:51:02.247292 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:02.247293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:02.247307 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:02.247379 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:02.247520 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.247957 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.248749 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:02.248935 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:02.249009 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:02.249161 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:02.249251 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:02.249340 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:02.249363 (+ 23us) server_negotiation.cc:299] Negotiation successful
0809 18:51:02.249383 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 18:51:02.251178 13858 raft_consensus.cc:1261] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4 [term 1 FOLLOWER]: Refusing update from remote peer 2c73a8a3f935496eac4d4ec6846e15d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:51:02.251183 13445 raft_consensus.cc:1261] T c9799b7604e14c46bd41c2307fcc9f8c P 6d7a80d5bcfe42e7a74c5afc9efd83c9 [term 1 FOLLOWER]: Refusing update from remote peer 2c73a8a3f935496eac4d4ec6846e15d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:51:02.251569 13970 consensus_queue.cc:1035] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d7a80d5bcfe42e7a74c5afc9efd83c9" member_type: VOTER last_known_addr { host: "127.12.202.193" port: 40843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:51:02.251729 13973 consensus_queue.cc:1035] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1d6f2a5dac64a41b7ded9e494c0c1a4" member_type: VOTER last_known_addr { host: "127.12.202.195" port: 46699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:51:02.254820 13979 mvcc.cc:205] Tried to move back new op lower bound from 7316690789378101248 to 7316690789350703104. Current Snapshot: MvccSnapshot[applied={T|T < 7316690789378101248 or (T in {7316690789378101248})}]
I20260809 18:51:02.256217 13226 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:51:02.256335 13226 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 18:51:02.257083 13226 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 126a7f52d177401693cbcaddcd89d333: Sending DeleteTablet for 3 replicas of tablet c9799b7604e14c46bd41c2307fcc9f8c
I20260809 18:51:02.257416 13621 tablet_service.cc:1514] Processing DeleteTablet for tablet c9799b7604e14c46bd41c2307fcc9f8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:51:02 UTC) from {username='slave'} at 127.0.0.1:35104
I20260809 18:51:02.257431 13830 tablet_service.cc:1514] Processing DeleteTablet for tablet c9799b7604e14c46bd41c2307fcc9f8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:51:02 UTC) from {username='slave'} at 127.0.0.1:45210
I20260809 18:51:02.257495 13406 tablet_service.cc:1514] Processing DeleteTablet for tablet c9799b7604e14c46bd41c2307fcc9f8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 18:51:02 UTC) from {username='slave'} at 127.0.0.1:36024
I20260809 18:51:02.257726 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 13315
I20260809 18:51:02.270539 13995 tablet_replica.cc:330] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9: stopping tablet replica
I20260809 18:51:02.270674 13995 raft_consensus.cc:2229] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [term 1 LEADER]: Raft consensus shutting down.
I20260809 18:51:02.270813 13995 raft_consensus.cc:2258] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:51:02.270982 13996 tablet_replica.cc:330] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4: stopping tablet replica
I20260809 18:51:02.271085 13996 raft_consensus.cc:2229] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 18:51:02.271181 13996 raft_consensus.cc:2258] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 18:51:02.271811 13996 ts_tablet_manager.cc:1905] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:51:02.272280 13995 ts_tablet_manager.cc:1905] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 18:51:02.273643 13996 ts_tablet_manager.cc:1918] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:51:02.273738 13996 log.cc:1196] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-2/wal/wals/c9799b7604e14c46bd41c2307fcc9f8c
I20260809 18:51:02.274024 13996 ts_tablet_manager.cc:1939] T c9799b7604e14c46bd41c2307fcc9f8c P d1d6f2a5dac64a41b7ded9e494c0c1a4: Deleting consensus metadata
I20260809 18:51:02.274066 13995 ts_tablet_manager.cc:1918] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 18:51:02.274144 13995 log.cc:1196] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9: Deleting WAL directory at /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786301184679835-13099-0/minicluster-data/ts-1/wal/wals/c9799b7604e14c46bd41c2307fcc9f8c
I20260809 18:51:02.274444 13995 ts_tablet_manager.cc:1939] T c9799b7604e14c46bd41c2307fcc9f8c P 2c73a8a3f935496eac4d4ec6846e15d9: Deleting consensus metadata
I20260809 18:51:02.274542 13204 catalog_manager.cc:4841] TS d1d6f2a5dac64a41b7ded9e494c0c1a4 (127.12.202.195:46699): tablet c9799b7604e14c46bd41c2307fcc9f8c (table test-table [id=15479e22b9f6413c8a8b7b5a69f81977]) successfully deleted
I20260809 18:51:02.276093 13204 catalog_manager.cc:4841] TS 2c73a8a3f935496eac4d4ec6846e15d9 (127.12.202.194:36353): tablet c9799b7604e14c46bd41c2307fcc9f8c (table test-table [id=15479e22b9f6413c8a8b7b5a69f81977]) successfully deleted
W20260809 18:51:02.280186 13205 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.202.193:40843 (error 108)
I20260809 18:51:02.280763 13942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:02.280616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.193:40843 (local address 127.0.0.1:56002)
0809 18:51:02.280680 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:02.280725 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.193:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 18:51:02.280891 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 13519
W20260809 18:51:02.286134 13205 catalog_manager.cc:4584] TS 6d7a80d5bcfe42e7a74c5afc9efd83c9 (127.12.202.193:40843): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c9799b7604e14c46bd41c2307fcc9f8c: Network error: Client connection negotiation failed: client connection to 127.12.202.193:40843: connect: Connection refused (error 111)
I20260809 18:51:02.294072 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 13728
I20260809 18:51:02.309861 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 13172
2026-08-09T18:51:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (751 ms)
[----------] 6 tests from EncryptionPolicyTest (9196 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:02 dist-test-slave-45dx krb5kdc[14001](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:02 dist-test-slave-45dx krb5kdc[14001](info): set up 2 sockets
Aug 09 18:51:02 dist-test-slave-45dx krb5kdc[14001](info): commencing operation
krb5kdc: starting...
W20260809 18:51:03.571075 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.233s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:03 dist-test-slave-45dx krb5kdc[14001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 18:51:03.691170 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37631
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37631
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:03.772512 14015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:03.772751 14015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:03.772790 14015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:03.773950 14015 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:03.774019 14015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:03.774044 14015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:03.774072 14015 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:03.774103 14015 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:03.775609 14015 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37631
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:03.775902 14015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:03.776131 14015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:03.781159 14022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:03.781183 14024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:03.781409 14021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:03.781476 14015 server_base.cc:1034] running on GCE node
I20260809 18:51:03.781788 14015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:03.782097 14015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:03.783267 14015 hybrid_clock.cc:648] HybridClock initialized: now 1786301463783261 us; error 36 us; skew 500 ppm
Aug 09 18:51:03 dist-test-slave-45dx krb5kdc[14001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301463, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:03.790750 14015 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 18:51:03.791205 14015 webserver.cc:460] Webserver started at http://127.0.0.1:36863/ using document root <none> and password file <none>
I20260809 18:51:03.791450 14015 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:03.791522 14015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:03.791677 14015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:03.792815 14015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "5568ad51e22f498f945190d9aac532e0"
format_stamp: "Formatted at 2026-08-09 18:51:03 on dist-test-slave-45dx"
server_key: "466f8a6b280d58db568a507bab2a59ba"
server_key_iv: "8566dbf60b0b630776717373bb62c8c9"
server_key_version: "encryptionkey@0"
I20260809 18:51:03.793195 14015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "5568ad51e22f498f945190d9aac532e0"
format_stamp: "Formatted at 2026-08-09 18:51:03 on dist-test-slave-45dx"
server_key: "466f8a6b280d58db568a507bab2a59ba"
server_key_iv: "8566dbf60b0b630776717373bb62c8c9"
server_key_version: "encryptionkey@0"
I20260809 18:51:03.794576 14015 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:51:03.795351 14033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:03.795528 14015 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:51:03.795639 14015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "5568ad51e22f498f945190d9aac532e0"
format_stamp: "Formatted at 2026-08-09 18:51:03 on dist-test-slave-45dx"
server_key: "466f8a6b280d58db568a507bab2a59ba"
server_key_iv: "8566dbf60b0b630776717373bb62c8c9"
server_key_version: "encryptionkey@0"
I20260809 18:51:03.795712 14015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:03.823959 14015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:03.825948 14015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:03.826115 14015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:03.830233 14015 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37631
I20260809 18:51:03.830274 14131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37631 every 8 connection(s)
I20260809 18:51:03.830682 14015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:03.831604 14133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:03.833956 14133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0: Bootstrap starting.
I20260809 18:51:03.834550 14133 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:03.834864 14133 log.cc:824] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:03.835558 14133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0: No bootstrap required, opened a new log
I20260809 18:51:03.835865 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 14015
I20260809 18:51:03.836024 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:03.836221 13099 external_mini_cluster.cc:1428] Setting key 6c45a041022772f17ca07a5181007390
I20260809 18:51:03.838066 14133 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5568ad51e22f498f945190d9aac532e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37631 } }
I20260809 18:51:03.838254 14133 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:03.838294 14133 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568ad51e22f498f945190d9aac532e0, State: Initialized, Role: FOLLOWER
I20260809 18:51:03.838431 14133 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5568ad51e22f498f945190d9aac532e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37631 } }
I20260809 18:51:03.838528 14133 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:03.838599 14133 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:03.838650 14133 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:03.839265 14133 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5568ad51e22f498f945190d9aac532e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37631 } }
I20260809 18:51:03.839354 14133 leader_election.cc:302] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5568ad51e22f498f945190d9aac532e0; no voters:
I20260809 18:51:03.839529 14133 leader_election.cc:288] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:03.839550 14138 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:03.839660 14138 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0 [term 1 LEADER]: Becoming Leader. State: Replica: 5568ad51e22f498f945190d9aac532e0, State: Running, Role: LEADER
I20260809 18:51:03.839742 14138 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5568ad51e22f498f945190d9aac532e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37631 } }
I20260809 18:51:03.839782 14133 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:03.840044 14138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5568ad51e22f498f945190d9aac532e0. Latest consensus state: current_term: 1 leader_uuid: "5568ad51e22f498f945190d9aac532e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5568ad51e22f498f945190d9aac532e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37631 } } }
I20260809 18:51:03.840116 14138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:03.840272 14140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5568ad51e22f498f945190d9aac532e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5568ad51e22f498f945190d9aac532e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37631 } } }
I20260809 18:51:03.840396 14140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:03.840348 14144 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:03.841928 14144 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 18:51:03 dist-test-slave-45dx krb5kdc[14001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 18:51:03.844225 14144 catalog_manager.cc:1347] Generated new cluster ID: 2b305d9739f54bc5907e2569bddc1147
I20260809 18:51:03.844278 14144 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:51:03.848259 14137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:03.836803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55233 (local address 127.0.0.1:37631)
0809 18:51:03.836998 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:03.837006 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:03.837030 (+ 24us) server_negotiation.cc:407] Connection header received
0809 18:51:03.837585 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:03.837592 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:03.837635 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:03.837741 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:03.838535 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:03.839916 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:03.841030 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:03.841582 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:03.841682 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:03.844643 (+ 2961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:03.844646 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:03.844647 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:03.844658 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:03.846368 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:03.846765 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:03.846769 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:03.846769 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:03.846861 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:03.847098 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:03.847099 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:03.847100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:03.847333 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:03.847979 (+ 646us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:03.848048 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 18:51:03.848122 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":107,"threads_started":1}
I20260809 18:51:03.849206 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:03.855739 14144 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:03.856453 14144 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:03.857131 14137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:03.850617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60723 (local address 127.0.0.1:37631)
0809 18:51:03.850654 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:03.850656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:03.850761 (+ 105us) server_negotiation.cc:407] Connection header received
0809 18:51:03.850819 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:03.850819 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:03.850829 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:03.850878 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:03.851389 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:03.851906 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:03.852656 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:03.852882 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:03.852967 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:03.854183 (+ 1216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:03.854184 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:03.854184 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:03.854192 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:03.855798 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:03.856189 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:03.856191 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:03.856191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:03.856244 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:03.856543 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:03.856545 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:03.856545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:03.856657 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:03.856768 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:03.856897 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 18:51:03.856956 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":8,"server-negotiator.queue_time_us":19}
I20260809 18:51:03.863454 14144 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5568ad51e22f498f945190d9aac532e0: Generated new TSK 0
I20260809 18:51:03.863631 14144 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:03.869304 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 14015
W20260809 18:51:03.881575 13999 connection.cc:535] client connection to 127.0.0.1:37631 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37631): Connection reset by peer (error 104)
2026-08-09T18:51:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1556 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:03 dist-test-slave-45dx krb5kdc[14178](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:03 dist-test-slave-45dx krb5kdc[14178](info): set up 2 sockets
Aug 09 18:51:03 dist-test-slave-45dx krb5kdc[14178](info): commencing operation
krb5kdc: starting...
W20260809 18:51:05.128466 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.233s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:05 dist-test-slave-45dx krb5kdc[14178](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 18:51:05.248802 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46311
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46311
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:05.331034 14200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:05.331276 14200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:05.331314 14200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:05.332510 14200 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:05.332573 14200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:05.332595 14200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:05.332615 14200 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:05.332645 14200 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:05.334121 14200 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46311
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46311
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:05.334394 14200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:05.334631 14200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:05.339710 14215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:05.339828 14212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:05.339802 14213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:05.340132 14200 server_base.cc:1034] running on GCE node
I20260809 18:51:05.340458 14200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:05.340752 14200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:05.341948 14200 hybrid_clock.cc:648] HybridClock initialized: now 1786301465341949 us; error 49 us; skew 500 ppm
Aug 09 18:51:05 dist-test-slave-45dx krb5kdc[14178](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301465, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:05.344678 14200 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 18:51:05.345134 14200 webserver.cc:460] Webserver started at http://127.0.0.1:38273/ using document root <none> and password file <none>
I20260809 18:51:05.345340 14200 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:05.345381 14200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:05.345468 14200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:05.346434 14200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "15e148a92f204d86a93efd076c80ae63"
format_stamp: "Formatted at 2026-08-09 18:51:05 on dist-test-slave-45dx"
server_key: "39ceb70dbba864b3bfa06900dada68de"
server_key_iv: "d8f1e1b1a770687a04e81b58ece6d861"
server_key_version: "encryptionkey@0"
I20260809 18:51:05.346720 14200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "15e148a92f204d86a93efd076c80ae63"
format_stamp: "Formatted at 2026-08-09 18:51:05 on dist-test-slave-45dx"
server_key: "39ceb70dbba864b3bfa06900dada68de"
server_key_iv: "d8f1e1b1a770687a04e81b58ece6d861"
server_key_version: "encryptionkey@0"
I20260809 18:51:05.347924 14200 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:51:05.348659 14225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:05.348845 14200 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:51:05.348964 14200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "15e148a92f204d86a93efd076c80ae63"
format_stamp: "Formatted at 2026-08-09 18:51:05 on dist-test-slave-45dx"
server_key: "39ceb70dbba864b3bfa06900dada68de"
server_key_iv: "d8f1e1b1a770687a04e81b58ece6d861"
server_key_version: "encryptionkey@0"
I20260809 18:51:05.349040 14200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:05.367513 14200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:05.369410 14200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:05.369594 14200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:05.373912 14200 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46311
I20260809 18:51:05.373948 14298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46311 every 8 connection(s)
I20260809 18:51:05.374328 14200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:05.375170 14299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:05.377418 14299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63: Bootstrap starting.
I20260809 18:51:05.377938 14299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:05.378168 14299 log.cc:824] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:05.378831 14299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63: No bootstrap required, opened a new log
I20260809 18:51:05.380393 14299 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15e148a92f204d86a93efd076c80ae63" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46311 } }
I20260809 18:51:05.380564 14299 raft_consensus.cc:374] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:05.380587 14299 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15e148a92f204d86a93efd076c80ae63, State: Initialized, Role: FOLLOWER
I20260809 18:51:05.380712 14299 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15e148a92f204d86a93efd076c80ae63" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46311 } }
I20260809 18:51:05.380790 14299 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:05.380812 14299 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:05.380841 14299 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:05.381312 14299 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15e148a92f204d86a93efd076c80ae63" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46311 } }
I20260809 18:51:05.381403 14299 leader_election.cc:302] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15e148a92f204d86a93efd076c80ae63; no voters:
I20260809 18:51:05.381528 14299 leader_election.cc:288] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:05.381590 14303 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:05.381772 14303 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63 [term 1 LEADER]: Becoming Leader. State: Replica: 15e148a92f204d86a93efd076c80ae63, State: Running, Role: LEADER
I20260809 18:51:05.381811 14299 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:05.381865 14303 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15e148a92f204d86a93efd076c80ae63" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46311 } }
I20260809 18:51:05.382217 14307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15e148a92f204d86a93efd076c80ae63. Latest consensus state: current_term: 1 leader_uuid: "15e148a92f204d86a93efd076c80ae63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15e148a92f204d86a93efd076c80ae63" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46311 } } }
I20260809 18:51:05.382308 14307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:05.382333 14306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "15e148a92f204d86a93efd076c80ae63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15e148a92f204d86a93efd076c80ae63" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46311 } } }
I20260809 18:51:05.382426 14306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:05.382568 14317 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:05.383093 14317 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:05.383807 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 14200
I20260809 18:51:05.383935 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:05.384137 13099 external_mini_cluster.cc:1428] Setting key 13e49d2791824e99958a432af0f042f4
I20260809 18:51:05.384846 14317 catalog_manager.cc:1347] Generated new cluster ID: 54e10e2465194196be29cc10b3de92cc
I20260809 18:51:05.384900 14317 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:51:05.389930 14334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:05.384631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40085 (local address 127.0.0.1:46311)
0809 18:51:05.384775 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:05.384785 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:05.384823 (+ 38us) server_negotiation.cc:407] Connection header received
0809 18:51:05.385030 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:05.385037 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:05.385091 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:05.385219 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:05.385476 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:05.386798 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:05.387914 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:05.388485 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:05.388602 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:05.389287 (+ 685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:05.389291 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:05.389291 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:05.389483 (+ 192us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:05.389516 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:05.389527 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:05.389596 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:05.389705 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 18:51:05.389728 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":74,"threads_started":1}
I20260809 18:51:05.390882 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:05.395697 14334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:05.392325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48253 (local address 127.0.0.1:46311)
0809 18:51:05.392357 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:05.392358 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:05.392496 (+ 138us) server_negotiation.cc:407] Connection header received
0809 18:51:05.392520 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:05.392521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:05.392542 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:05.392604 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:05.392718 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:05.393410 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:05.394405 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:05.394723 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:05.394795 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:05.395441 (+ 646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:05.395443 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:05.395443 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:05.395447 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:05.395462 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:05.395466 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:05.395542 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:05.395614 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 18:51:05.395626 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 18:51:05.402267 14317 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:05.402745 14317 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:05.405465 14317 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15e148a92f204d86a93efd076c80ae63: Generated new TSK 0
I20260809 18:51:05.405632 14317 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:05.409296 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 14200
W20260809 18:51:05.425879 14173 connection.cc:535] client connection to 127.0.0.1:46311 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46311): Connection reset by peer (error 104)
2026-08-09T18:51:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1544 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:05 dist-test-slave-45dx krb5kdc[14347](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:05 dist-test-slave-45dx krb5kdc[14347](info): set up 2 sockets
Aug 09 18:51:05 dist-test-slave-45dx krb5kdc[14347](info): commencing operation
krb5kdc: starting...
W20260809 18:51:06.673817 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:06 dist-test-slave-45dx krb5kdc[14347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 18:51:06.796356 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37761
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37761
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:06.876261 14364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:06.876623 14364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:06.876669 14364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:06.877810 14364 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:06.877857 14364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:06.877871 14364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:06.877883 14364 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:06.877895 14364 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:06.879380 14364 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37761
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:06.879645 14364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:06.879873 14364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:06.884859 14373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:06.884851 14379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:06.884984 14375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:06.885120 14364 server_base.cc:1034] running on GCE node
I20260809 18:51:06.885382 14364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:06.885680 14364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:06.886822 14364 hybrid_clock.cc:648] HybridClock initialized: now 1786301466886811 us; error 32 us; skew 500 ppm
Aug 09 18:51:06 dist-test-slave-45dx krb5kdc[14347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301466, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:06.889323 14364 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 18:51:06.889743 14364 webserver.cc:460] Webserver started at http://127.0.0.1:33277/ using document root <none> and password file <none>
I20260809 18:51:06.889979 14364 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:06.890024 14364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:06.890189 14364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:06.891285 14364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "73aff58754224e15a630e3ca12037c90"
format_stamp: "Formatted at 2026-08-09 18:51:06 on dist-test-slave-45dx"
server_key: "64fc34856b7f2d77e4477f36326257a5"
server_key_iv: "cebb68851c88266e36a20a2e24ad93d6"
server_key_version: "encryptionkey@0"
I20260809 18:51:06.891655 14364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "73aff58754224e15a630e3ca12037c90"
format_stamp: "Formatted at 2026-08-09 18:51:06 on dist-test-slave-45dx"
server_key: "64fc34856b7f2d77e4477f36326257a5"
server_key_iv: "cebb68851c88266e36a20a2e24ad93d6"
server_key_version: "encryptionkey@0"
I20260809 18:51:06.893091 14364 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:51:06.893867 14392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:06.894068 14364 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:51:06.894181 14364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "73aff58754224e15a630e3ca12037c90"
format_stamp: "Formatted at 2026-08-09 18:51:06 on dist-test-slave-45dx"
server_key: "64fc34856b7f2d77e4477f36326257a5"
server_key_iv: "cebb68851c88266e36a20a2e24ad93d6"
server_key_version: "encryptionkey@0"
I20260809 18:51:06.894256 14364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:06.897549 14364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:06.899439 14364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:06.899600 14364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:06.903596 14364 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37761
I20260809 18:51:06.903626 14476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37761 every 8 connection(s)
I20260809 18:51:06.903949 14364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:06.904985 14477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:06.907161 14477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90: Bootstrap starting.
I20260809 18:51:06.907748 14477 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:06.908032 14477 log.cc:824] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:06.908746 14477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90: No bootstrap required, opened a new log
I20260809 18:51:06.910328 14477 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73aff58754224e15a630e3ca12037c90" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37761 } }
I20260809 18:51:06.910463 14477 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:06.910511 14477 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73aff58754224e15a630e3ca12037c90, State: Initialized, Role: FOLLOWER
I20260809 18:51:06.910677 14477 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73aff58754224e15a630e3ca12037c90" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37761 } }
I20260809 18:51:06.910742 14477 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:06.910763 14477 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:06.910828 14477 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:06.911137 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 14364
I20260809 18:51:06.911290 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:06.911430 14477 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73aff58754224e15a630e3ca12037c90" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37761 } }
I20260809 18:51:06.911509 13099 external_mini_cluster.cc:1428] Setting key 4ed61eaf4155075dce6d551c18487d8f
I20260809 18:51:06.911545 14477 leader_election.cc:302] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73aff58754224e15a630e3ca12037c90; no voters:
I20260809 18:51:06.911715 14477 leader_election.cc:288] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:06.911741 14484 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:06.911929 14484 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90 [term 1 LEADER]: Becoming Leader. State: Replica: 73aff58754224e15a630e3ca12037c90, State: Running, Role: LEADER
I20260809 18:51:06.911983 14477 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:06.912025 14484 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73aff58754224e15a630e3ca12037c90" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37761 } }
I20260809 18:51:06.912371 14488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73aff58754224e15a630e3ca12037c90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73aff58754224e15a630e3ca12037c90" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37761 } } }
I20260809 18:51:06.912463 14488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:06.912362 14484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73aff58754224e15a630e3ca12037c90. Latest consensus state: current_term: 1 leader_uuid: "73aff58754224e15a630e3ca12037c90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73aff58754224e15a630e3ca12037c90" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37761 } } }
I20260809 18:51:06.912657 14484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:06.914139 14493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:06.912146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37921 (local address 127.0.0.1:37761)
0809 18:51:06.912428 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:06.912437 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:06.912555 (+ 118us) server_negotiation.cc:407] Connection header received
0809 18:51:06.912777 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:06.912784 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:06.912816 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:06.913252 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:06.913693 (+ 441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:06.913696 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:06.913696 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:06.913699 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:06.913731 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:06.913741 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:06.913793 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:06.913875 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 18:51:06.913926 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":81,"threads_started":1}
W20260809 18:51:06.914494 14512 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:51:06.914546 14512 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:51:06.914613 14496 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:06.914764 14496 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:06.915268 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:06.916744 14496 catalog_manager.cc:1347] Generated new cluster ID: 726dd6ddb63b460b94528b3307cfd70e
I20260809 18:51:06.916796 14496 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:51:06.917639 14493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:06.916607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49915 (local address 127.0.0.1:37761)
0809 18:51:06.916647 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:06.916649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:06.916703 (+ 54us) server_negotiation.cc:407] Connection header received
0809 18:51:06.916773 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:06.916773 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:06.916779 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:06.916831 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:06.917433 (+ 602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:06.917434 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:06.917434 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:06.917438 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:06.917451 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:06.917455 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:06.917508 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:06.917564 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 18:51:06.917578 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:51:06.925361 14496 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:06.925521 14496 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:06.927760 14496 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73aff58754224e15a630e3ca12037c90: Generated new TSK 0
I20260809 18:51:06.927914 14496 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:06.934676 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 14364
2026-08-09T18:51:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1522 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:06 dist-test-slave-45dx krb5kdc[14528](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:06 dist-test-slave-45dx krb5kdc[14528](info): set up 2 sockets
Aug 09 18:51:06 dist-test-slave-45dx krb5kdc[14528](info): commencing operation
krb5kdc: starting...
W20260809 18:51:08.171190 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:08 dist-test-slave-45dx krb5kdc[14528](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 18:51:08.302733 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45201
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:08.385027 14549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:08.385228 14549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:08.385250 14549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:08.386308 14549 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:08.386343 14549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:08.386356 14549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:08.386368 14549 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:08.386380 14549 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:08.387744 14549 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:08.387928 14549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:08.388084 14549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:08.393090 14558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:08.393082 14556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:08.393170 14549 server_base.cc:1034] running on GCE node
W20260809 18:51:08.393080 14555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:08.393536 14549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:08.393821 14549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:08.395013 14549 hybrid_clock.cc:648] HybridClock initialized: now 1786301468394999 us; error 47 us; skew 500 ppm
Aug 09 18:51:08 dist-test-slave-45dx krb5kdc[14528](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301468, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:08.397405 14549 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 18:51:08.397871 14549 webserver.cc:460] Webserver started at http://127.0.0.1:36373/ using document root <none> and password file <none>
I20260809 18:51:08.398109 14549 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:08.398178 14549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:08.398329 14549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:08.399305 14549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "7f57f29df2f9471a880faca6969242ee"
format_stamp: "Formatted at 2026-08-09 18:51:08 on dist-test-slave-45dx"
server_key: "cccdb658041580e916ef12c4ff888a46"
server_key_iv: "d72fb736739a0ac845ec755ed2cff1e6"
server_key_version: "encryptionkey@0"
I20260809 18:51:08.399662 14549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "7f57f29df2f9471a880faca6969242ee"
format_stamp: "Formatted at 2026-08-09 18:51:08 on dist-test-slave-45dx"
server_key: "cccdb658041580e916ef12c4ff888a46"
server_key_iv: "d72fb736739a0ac845ec755ed2cff1e6"
server_key_version: "encryptionkey@0"
I20260809 18:51:08.401088 14549 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:51:08.401788 14572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:08.401976 14549 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:08.402065 14549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "7f57f29df2f9471a880faca6969242ee"
format_stamp: "Formatted at 2026-08-09 18:51:08 on dist-test-slave-45dx"
server_key: "cccdb658041580e916ef12c4ff888a46"
server_key_iv: "d72fb736739a0ac845ec755ed2cff1e6"
server_key_version: "encryptionkey@0"
I20260809 18:51:08.402146 14549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:08.423722 14549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:08.425710 14549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:08.425890 14549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:08.430121 14549 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45201
I20260809 18:51:08.430157 14650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45201 every 8 connection(s)
I20260809 18:51:08.430527 14549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:08.431404 14651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:08.433759 14651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee: Bootstrap starting.
I20260809 18:51:08.434360 14651 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:08.434654 14651 log.cc:824] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:08.435338 14651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee: No bootstrap required, opened a new log
I20260809 18:51:08.437062 14651 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f57f29df2f9471a880faca6969242ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45201 } }
I20260809 18:51:08.437196 14651 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:08.437217 14651 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f57f29df2f9471a880faca6969242ee, State: Initialized, Role: FOLLOWER
I20260809 18:51:08.437377 14651 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f57f29df2f9471a880faca6969242ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45201 } }
I20260809 18:51:08.437440 14651 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:08.437479 14651 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:08.437530 14651 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:08.438047 14651 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f57f29df2f9471a880faca6969242ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45201 } }
I20260809 18:51:08.438134 14651 leader_election.cc:302] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f57f29df2f9471a880faca6969242ee; no voters:
I20260809 18:51:08.438373 14651 leader_election.cc:288] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:08.438410 14656 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:08.438449 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 14549
I20260809 18:51:08.438567 14656 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee [term 1 LEADER]: Becoming Leader. State: Replica: 7f57f29df2f9471a880faca6969242ee, State: Running, Role: LEADER
I20260809 18:51:08.438580 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:08.438637 14651 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:08.438650 14656 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f57f29df2f9471a880faca6969242ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45201 } }
I20260809 18:51:08.438832 13099 external_mini_cluster.cc:1428] Setting key e6e79c722e3faac33cc538eed5a2a06c
I20260809 18:51:08.439025 14656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f57f29df2f9471a880faca6969242ee. Latest consensus state: current_term: 1 leader_uuid: "7f57f29df2f9471a880faca6969242ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f57f29df2f9471a880faca6969242ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45201 } } }
I20260809 18:51:08.439096 14656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:08.439283 14657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f57f29df2f9471a880faca6969242ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f57f29df2f9471a880faca6969242ee" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45201 } } }
I20260809 18:51:08.439345 14657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:08.439457 14665 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:08.440589 14665 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:08.442233 14665 catalog_manager.cc:1347] Generated new cluster ID: d1e1cf372e544b47b4679b3952da5ae7
I20260809 18:51:08.442287 14665 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:51:08 dist-test-slave-45dx krb5kdc[14528](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 18:51:08.447302 14665 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:08.447897 14665 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:08.451460 14673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:08.439497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44085 (local address 127.0.0.1:45201)
0809 18:51:08.440053 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:08.440063 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:08.440094 (+ 31us) server_negotiation.cc:407] Connection header received
0809 18:51:08.440205 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:08.440212 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:08.440265 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:08.440414 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:08.441340 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:08.442785 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:08.443846 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:08.444537 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:08.444647 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:08.447648 (+ 3001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:08.447652 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:08.447652 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:08.447664 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:08.449824 (+ 2160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:08.450214 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:08.450217 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:08.450217 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:08.450334 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:08.450545 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:08.450546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:08.450547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:08.450863 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:08.451030 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:08.451098 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 18:51:08.451247 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":85,"threads_started":1}
I20260809 18:51:08.452509 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:08.458897 14665 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f57f29df2f9471a880faca6969242ee: Generated new TSK 0
I20260809 18:51:08.459074 14665 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:08.463411 14673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:08.454076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45907 (local address 127.0.0.1:45201)
0809 18:51:08.456356 (+ 2280us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:08.456358 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:08.456366 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:51:08.456384 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:08.456385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:08.456419 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:08.456471 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:08.457278 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:08.458088 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:08.459051 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:08.459332 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:08.459387 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:08.460808 (+ 1421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:08.460810 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:08.460810 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:08.460816 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:08.462252 (+ 1436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:08.462679 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:08.462680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:08.462681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:08.462741 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:08.462963 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:08.462963 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:08.462963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:08.463062 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:08.463135 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:08.463283 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 18:51:08.463349 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2259}
I20260809 18:51:08.465662 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 14549
2026-08-09T18:51:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1530 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:08 dist-test-slave-45dx krb5kdc[14700](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:08 dist-test-slave-45dx krb5kdc[14700](info): set up 2 sockets
Aug 09 18:51:08 dist-test-slave-45dx krb5kdc[14700](info): commencing operation
krb5kdc: starting...
W20260809 18:51:09.727831 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:09 dist-test-slave-45dx krb5kdc[14700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 18:51:09.849313 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36943
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:09.931756 14719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:09.931981 14719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:09.932005 14719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:09.933163 14719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:09.933200 14719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:09.933215 14719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:09.933228 14719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:09.933240 14719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:09.934638 14719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36943
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:09.934837 14719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:09.935014 14719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:09.940155 14729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:09.940171 14730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:09.940176 14732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:09.940189 14719 server_base.cc:1034] running on GCE node
I20260809 18:51:09.940667 14719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:09.940974 14719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:09.942144 14719 hybrid_clock.cc:648] HybridClock initialized: now 1786301469942120 us; error 57 us; skew 500 ppm
Aug 09 18:51:09 dist-test-slave-45dx krb5kdc[14700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301469, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:09.949770 14719 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 18:51:09.950274 14719 webserver.cc:460] Webserver started at http://127.0.0.1:46647/ using document root <none> and password file <none>
I20260809 18:51:09.950508 14719 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:09.950577 14719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:09.950753 14719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:09.951836 14719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "18243f9f79dc49f2923f9257f4f0baa9"
format_stamp: "Formatted at 2026-08-09 18:51:09 on dist-test-slave-45dx"
server_key: "7cc3c74c01318822381a34ee56e406e2"
server_key_iv: "a69b17bd9a99bb2a2f71cf2090f31530"
server_key_version: "encryptionkey@0"
I20260809 18:51:09.952214 14719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "18243f9f79dc49f2923f9257f4f0baa9"
format_stamp: "Formatted at 2026-08-09 18:51:09 on dist-test-slave-45dx"
server_key: "7cc3c74c01318822381a34ee56e406e2"
server_key_iv: "a69b17bd9a99bb2a2f71cf2090f31530"
server_key_version: "encryptionkey@0"
I20260809 18:51:09.953640 14719 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:51:09.954449 14743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:09.954650 14719 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:51:09.954756 14719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "18243f9f79dc49f2923f9257f4f0baa9"
format_stamp: "Formatted at 2026-08-09 18:51:09 on dist-test-slave-45dx"
server_key: "7cc3c74c01318822381a34ee56e406e2"
server_key_iv: "a69b17bd9a99bb2a2f71cf2090f31530"
server_key_version: "encryptionkey@0"
I20260809 18:51:09.954846 14719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:09.965667 14719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:09.968039 14719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:09.968209 14719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:09.972543 14719 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36943
I20260809 18:51:09.972577 14821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36943 every 8 connection(s)
I20260809 18:51:09.972959 14719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:09.973873 14822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:09.974138 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 14719
I20260809 18:51:09.974274 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:09.974478 13099 external_mini_cluster.cc:1428] Setting key 56e9ed662b1ba20812301ec47cce2cc8
I20260809 18:51:09.976678 14822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9: Bootstrap starting.
I20260809 18:51:09.977301 14822 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:09.977610 14822 log.cc:824] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:09.978338 14822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9: No bootstrap required, opened a new log
I20260809 18:51:09.980041 14825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:09.975013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54811 (local address 127.0.0.1:36943)
0809 18:51:09.975237 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:09.975253 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:09.975280 (+ 27us) server_negotiation.cc:407] Connection header received
0809 18:51:09.975696 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:09.975702 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:09.975747 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:09.975901 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:09.976139 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:09.977138 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:09.978072 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:09.978528 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:09.978647 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:09.979438 (+ 791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:09.979442 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:09.979442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:09.979606 (+ 164us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:09.979635 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:09.979646 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:09.979721 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:09.979802 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 18:51:09.979867 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":87,"threads_started":1}
I20260809 18:51:09.980609 14822 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18243f9f79dc49f2923f9257f4f0baa9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36943 } }
I20260809 18:51:09.980806 14822 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:09.980855 14822 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18243f9f79dc49f2923f9257f4f0baa9, State: Initialized, Role: FOLLOWER
I20260809 18:51:09.981050 14822 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18243f9f79dc49f2923f9257f4f0baa9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36943 } }
I20260809 18:51:09.981115 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:09.981171 14822 raft_consensus.cc:388] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:09.981204 14822 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:09.981251 14822 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:09.982007 14822 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18243f9f79dc49f2923f9257f4f0baa9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36943 } }
I20260809 18:51:09.982126 14822 leader_election.cc:302] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18243f9f79dc49f2923f9257f4f0baa9; no voters:
I20260809 18:51:09.982298 14822 leader_election.cc:288] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:09.982403 14832 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:09.982589 14822 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:09.982594 14832 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9 [term 1 LEADER]: Becoming Leader. State: Replica: 18243f9f79dc49f2923f9257f4f0baa9, State: Running, Role: LEADER
I20260809 18:51:09.982892 14832 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18243f9f79dc49f2923f9257f4f0baa9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36943 } }
I20260809 18:51:09.983372 14835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "18243f9f79dc49f2923f9257f4f0baa9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18243f9f79dc49f2923f9257f4f0baa9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36943 } } }
I20260809 18:51:09.983516 14835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:09.983392 14836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18243f9f79dc49f2923f9257f4f0baa9. Latest consensus state: current_term: 1 leader_uuid: "18243f9f79dc49f2923f9257f4f0baa9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18243f9f79dc49f2923f9257f4f0baa9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36943 } } }
I20260809 18:51:09.983774 14836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:09.983786 14846 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:09.984942 14846 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:09.986454 14825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:09.982735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39371 (local address 127.0.0.1:36943)
0809 18:51:09.982773 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:09.982775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:09.982969 (+ 194us) server_negotiation.cc:407] Connection header received
0809 18:51:09.983016 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:09.983017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:09.983028 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:09.983088 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:09.983214 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:09.984029 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:09.985064 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:09.985346 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:09.985439 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:09.986177 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:09.986179 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:09.986179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:09.986183 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:09.986199 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:09.986203 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:09.986265 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:09.986341 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 18:51:09.986365 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 18:51:09.986779 14846 catalog_manager.cc:1347] Generated new cluster ID: f3344371c4244d17a9bfc8beb4092a60
I20260809 18:51:09.986835 14846 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:51:09.995249 14846 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:09.995759 14846 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:10.000490 14846 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 18243f9f79dc49f2923f9257f4f0baa9: Generated new TSK 0
I20260809 18:51:10.000680 14846 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:10.007211 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 14719
2026-08-09T18:51:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1549 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:10 dist-test-slave-45dx krb5kdc[14865](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:10 dist-test-slave-45dx krb5kdc[14865](info): set up 2 sockets
Aug 09 18:51:10 dist-test-slave-45dx krb5kdc[14865](info): commencing operation
krb5kdc: starting...
W20260809 18:51:11.276670 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:11 dist-test-slave-45dx krb5kdc[14865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301471, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 18:51:11.404820 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42007
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42007
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:11.485518 14884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:11.485733 14884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:11.485771 14884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:11.486837 14884 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:11.486907 14884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:11.486928 14884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:11.486958 14884 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:11.486985 14884 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:11.488602 14884 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42007
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:11.488885 14884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:11.489106 14884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:11.494151 14895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:11.494249 14884 server_base.cc:1034] running on GCE node
W20260809 18:51:11.494163 14899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:11.494163 14893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:11.494632 14884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:11.494931 14884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:11.496104 14884 hybrid_clock.cc:648] HybridClock initialized: now 1786301471496097 us; error 38 us; skew 500 ppm
Aug 09 18:51:11 dist-test-slave-45dx krb5kdc[14865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301471, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:11.498652 14884 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 18:51:11.499058 14884 webserver.cc:460] Webserver started at http://127.0.0.1:36359/ using document root <none> and password file <none>
I20260809 18:51:11.499305 14884 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:11.499385 14884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:11.499544 14884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:11.500698 14884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "ed4017dfe1c64eeaa942a13d155e553a"
format_stamp: "Formatted at 2026-08-09 18:51:11 on dist-test-slave-45dx"
server_key: "5cd006b1d47c512544dec150b424bae5"
server_key_iv: "ba2db6a9688e68467fa8a9c4f0ca4f74"
server_key_version: "encryptionkey@0"
I20260809 18:51:11.501060 14884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "ed4017dfe1c64eeaa942a13d155e553a"
format_stamp: "Formatted at 2026-08-09 18:51:11 on dist-test-slave-45dx"
server_key: "5cd006b1d47c512544dec150b424bae5"
server_key_iv: "ba2db6a9688e68467fa8a9c4f0ca4f74"
server_key_version: "encryptionkey@0"
I20260809 18:51:11.502410 14884 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260809 18:51:11.503089 14912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:11.503289 14884 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:11.503407 14884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "ed4017dfe1c64eeaa942a13d155e553a"
format_stamp: "Formatted at 2026-08-09 18:51:11 on dist-test-slave-45dx"
server_key: "5cd006b1d47c512544dec150b424bae5"
server_key_iv: "ba2db6a9688e68467fa8a9c4f0ca4f74"
server_key_version: "encryptionkey@0"
I20260809 18:51:11.503480 14884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:11.506659 14884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:11.508976 14884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:11.509136 14884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:11.513099 14884 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42007
I20260809 18:51:11.513149 14997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42007 every 8 connection(s)
I20260809 18:51:11.513476 14884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:11.514447 14998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:11.516623 14998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a: Bootstrap starting.
I20260809 18:51:11.517140 14998 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:11.517403 14998 log.cc:824] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:11.518028 14998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a: No bootstrap required, opened a new log
I20260809 18:51:11.519505 14998 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed4017dfe1c64eeaa942a13d155e553a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42007 } }
I20260809 18:51:11.519630 14998 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:11.519652 14998 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed4017dfe1c64eeaa942a13d155e553a, State: Initialized, Role: FOLLOWER
I20260809 18:51:11.519747 14998 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed4017dfe1c64eeaa942a13d155e553a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42007 } }
I20260809 18:51:11.519795 14998 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:11.519816 14998 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:11.519843 14998 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:11.520246 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 14884
I20260809 18:51:11.520414 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:11.520434 14998 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed4017dfe1c64eeaa942a13d155e553a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42007 } }
I20260809 18:51:11.520560 14998 leader_election.cc:302] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed4017dfe1c64eeaa942a13d155e553a; no voters:
I20260809 18:51:11.520648 13099 external_mini_cluster.cc:1428] Setting key 76fa2c9bfe567b0f6ef4eb7a9e0e90cf
I20260809 18:51:11.520717 14998 leader_election.cc:288] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:11.520752 15002 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:11.520881 15002 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a [term 1 LEADER]: Becoming Leader. State: Replica: ed4017dfe1c64eeaa942a13d155e553a, State: Running, Role: LEADER
I20260809 18:51:11.520982 14998 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:11.520994 15002 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed4017dfe1c64eeaa942a13d155e553a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42007 } }
I20260809 18:51:11.521628 15004 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed4017dfe1c64eeaa942a13d155e553a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed4017dfe1c64eeaa942a13d155e553a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42007 } } }
I20260809 18:51:11.521648 15005 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed4017dfe1c64eeaa942a13d155e553a. Latest consensus state: current_term: 1 leader_uuid: "ed4017dfe1c64eeaa942a13d155e553a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed4017dfe1c64eeaa942a13d155e553a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42007 } } }
I20260809 18:51:11.521809 15004 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:11.521828 15005 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:11.522185 15018 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:11.522800 15018 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:11.523530 15007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:11.521126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50149 (local address 127.0.0.1:42007)
0809 18:51:11.521439 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:11.521448 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:11.521487 (+ 39us) server_negotiation.cc:407] Connection header received
0809 18:51:11.522136 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:11.522145 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:11.522179 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:11.522627 (+ 448us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:11.523020 (+ 393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:11.523023 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:11.523024 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:11.523027 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:11.523055 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:11.523064 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:11.523148 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:11.523359 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 18:51:11.523397 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":80,"threads_started":1}
I20260809 18:51:11.524403 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:11.524664 15018 catalog_manager.cc:1347] Generated new cluster ID: a8e9644fc347433d890702f29d603246
I20260809 18:51:11.524716 15018 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:51:11.531085 15007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:11.525856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48963 (local address 127.0.0.1:42007)
0809 18:51:11.525896 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:11.525898 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:11.530114 (+ 4216us) server_negotiation.cc:407] Connection header received
0809 18:51:11.530187 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:11.530188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:11.530194 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:11.530249 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:11.530834 (+ 585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:11.530836 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:11.530836 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:11.530840 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:11.530854 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:11.530859 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:11.530929 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:11.530998 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 18:51:11.531012 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:51:11.544335 15018 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:11.544510 15018 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:11.549154 15018 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed4017dfe1c64eeaa942a13d155e553a: Generated new TSK 0
I20260809 18:51:11.549327 15018 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:11.554152 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 14884
2026-08-09T18:51:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1544 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:11 dist-test-slave-45dx krb5kdc[15045](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:11 dist-test-slave-45dx krb5kdc[15045](info): set up 2 sockets
Aug 09 18:51:11 dist-test-slave-45dx krb5kdc[15045](info): commencing operation
krb5kdc: starting...
W20260809 18:51:12.810796 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:12 dist-test-slave-45dx krb5kdc[15045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301472, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 18:51:12.928547 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40029
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40029
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:13.008975 15068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:13.009169 15068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:13.009191 15068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:13.010299 15068 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:13.010342 15068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:13.010356 15068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:13.010375 15068 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:13.010414 15068 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:13.011931 15068 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40029
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:13.012182 15068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:13.012458 15068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:13.017146 15081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:13.017257 15068 server_base.cc:1034] running on GCE node
W20260809 18:51:13.017172 15079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:13.017146 15078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:13.017632 15068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:13.017935 15068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:13.019106 15068 hybrid_clock.cc:648] HybridClock initialized: now 1786301473019100 us; error 35 us; skew 500 ppm
Aug 09 18:51:13 dist-test-slave-45dx krb5kdc[15045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301473, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:13.021641 15068 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 18:51:13.022071 15068 webserver.cc:460] Webserver started at http://127.0.0.1:40739/ using document root <none> and password file <none>
I20260809 18:51:13.022330 15068 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:13.022413 15068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:13.022563 15068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:13.023604 15068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "2fa55e6c2f29473da1055fec2a6b495b"
format_stamp: "Formatted at 2026-08-09 18:51:13 on dist-test-slave-45dx"
server_key: "7d80b987bd4743eb55e322adbb232845"
server_key_iv: "6ff507d5dbed47a90c951e0f8b94bcdc"
server_key_version: "encryptionkey@0"
I20260809 18:51:13.023952 15068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "2fa55e6c2f29473da1055fec2a6b495b"
format_stamp: "Formatted at 2026-08-09 18:51:13 on dist-test-slave-45dx"
server_key: "7d80b987bd4743eb55e322adbb232845"
server_key_iv: "6ff507d5dbed47a90c951e0f8b94bcdc"
server_key_version: "encryptionkey@0"
I20260809 18:51:13.025302 15068 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 18:51:13.026046 15088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:13.026219 15068 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:51:13.026328 15068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "2fa55e6c2f29473da1055fec2a6b495b"
format_stamp: "Formatted at 2026-08-09 18:51:13 on dist-test-slave-45dx"
server_key: "7d80b987bd4743eb55e322adbb232845"
server_key_iv: "6ff507d5dbed47a90c951e0f8b94bcdc"
server_key_version: "encryptionkey@0"
I20260809 18:51:13.026413 15068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:13.041888 15068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:13.043789 15068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:13.043962 15068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:13.047961 15068 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40029
I20260809 18:51:13.048003 15164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40029 every 8 connection(s)
I20260809 18:51:13.048450 15068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:13.049436 15166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:13.051947 15166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b: Bootstrap starting.
I20260809 18:51:13.052677 15166 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:13.053006 15166 log.cc:824] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:13.053329 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 15068
I20260809 18:51:13.053467 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:13.053653 13099 external_mini_cluster.cc:1428] Setting key 57aa93ad976d69c17fc908879109026f
I20260809 18:51:13.053892 15166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b: No bootstrap required, opened a new log
I20260809 18:51:13.056510 15166 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fa55e6c2f29473da1055fec2a6b495b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40029 } }
I20260809 18:51:13.056670 15166 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:13.056716 15166 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa55e6c2f29473da1055fec2a6b495b, State: Initialized, Role: FOLLOWER
I20260809 18:51:13.056849 15166 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fa55e6c2f29473da1055fec2a6b495b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40029 } }
I20260809 18:51:13.056944 15166 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:13.056988 15166 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:13.057035 15166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:13.057595 15166 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fa55e6c2f29473da1055fec2a6b495b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40029 } }
I20260809 18:51:13.057709 15166 leader_election.cc:302] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fa55e6c2f29473da1055fec2a6b495b; no voters:
I20260809 18:51:13.057881 15166 leader_election.cc:288] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:13.057961 15174 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:13.058135 15166 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:13.058145 15174 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b [term 1 LEADER]: Becoming Leader. State: Replica: 2fa55e6c2f29473da1055fec2a6b495b, State: Running, Role: LEADER
I20260809 18:51:13.058341 15174 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fa55e6c2f29473da1055fec2a6b495b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40029 } }
I20260809 18:51:13.058745 15176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2fa55e6c2f29473da1055fec2a6b495b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fa55e6c2f29473da1055fec2a6b495b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40029 } } }
I20260809 18:51:13.058737 15174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fa55e6c2f29473da1055fec2a6b495b. Latest consensus state: current_term: 1 leader_uuid: "2fa55e6c2f29473da1055fec2a6b495b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fa55e6c2f29473da1055fec2a6b495b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40029 } } }
I20260809 18:51:13.058858 15176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:13.058867 15174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:13.059110 15191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:13.059646 15191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:13.061542 15191 catalog_manager.cc:1347] Generated new cluster ID: 39733272f2ae49e49231b106e5ac1162
I20260809 18:51:13.061601 15191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:51:13 dist-test-slave-45dx krb5kdc[15045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301472, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 18:51:13.066382 15173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:13.054277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:42995 (local address 127.0.0.1:40029)
0809 18:51:13.054463 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:13.054472 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:13.054520 (+ 48us) server_negotiation.cc:407] Connection header received
0809 18:51:13.055351 (+ 831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:13.055359 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:13.055411 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:13.055526 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:13.056402 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:13.057670 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:13.058810 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:13.059508 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:13.059604 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:13.062686 (+ 3082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:13.062690 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:13.062690 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:13.062702 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:13.064728 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:13.065135 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:13.065138 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:13.065139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:13.065243 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:13.065461 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:13.065462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:13.065462 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:13.065756 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:13.065918 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:13.066034 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 18:51:13.066146 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":105,"threads_started":1}
I20260809 18:51:13.067610 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:13.071872 15191 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:13.072608 15191 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:13.075955 15173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:13.069101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:48801 (local address 127.0.0.1:40029)
0809 18:51:13.069135 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:13.069137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:13.069242 (+ 105us) server_negotiation.cc:407] Connection header received
0809 18:51:13.069296 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:13.069297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:13.069306 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:13.069354 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:13.069981 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:13.070666 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:13.071687 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:13.071988 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:13.072056 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:13.073319 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:13.073321 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:13.073321 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:13.073328 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:13.074758 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:13.075126 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:13.075127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:13.075128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:13.075181 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:13.075413 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:13.075414 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:13.075414 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:13.075526 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:13.075636 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:13.075763 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 18:51:13.075828 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 18:51:13.080196 15191 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2fa55e6c2f29473da1055fec2a6b495b: Generated new TSK 0
I20260809 18:51:13.080387 15191 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:13.083477 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 15068
W20260809 18:51:13.102056 15039 connection.cc:535] client connection to 127.0.0.1:40029 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40029): Connection reset by peer (error 104)
2026-08-09T18:51:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1529 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:13 dist-test-slave-45dx krb5kdc[15224](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:13 dist-test-slave-45dx krb5kdc[15224](info): set up 2 sockets
Aug 09 18:51:13 dist-test-slave-45dx krb5kdc[15224](info): commencing operation
krb5kdc: starting...
W20260809 18:51:14.402077 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:14 dist-test-slave-45dx krb5kdc[15224](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 18:51:14.517156 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41521
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41521
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:14.598132 15242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:14.598335 15242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:14.598357 15242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:14.599412 15242 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:14.599447 15242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:14.599460 15242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:14.599472 15242 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:14.599484 15242 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:14.600871 15242 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41521
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:14.601096 15242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:14.601269 15242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:14.606127 15250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:14.606114 15253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:14.606132 15251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:14.606372 15242 server_base.cc:1034] running on GCE node
I20260809 18:51:14.606711 15242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:14.607017 15242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:14.608162 15242 hybrid_clock.cc:648] HybridClock initialized: now 1786301474608153 us; error 31 us; skew 500 ppm
Aug 09 18:51:14 dist-test-slave-45dx krb5kdc[15224](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301474, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:14.610646 15242 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 18:51:14.611073 15242 webserver.cc:460] Webserver started at http://127.0.0.1:40933/ using document root <none> and password file <none>
I20260809 18:51:14.611334 15242 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:14.611415 15242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:14.611588 15242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:14.612731 15242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "5e15ce546214444d9f751e5078fa5e7d"
format_stamp: "Formatted at 2026-08-09 18:51:14 on dist-test-slave-45dx"
server_key: "66c2998b36dde3c3470071d92ddb6989"
server_key_iv: "a2d933c829f75be8a91e153410b4105c"
server_key_version: "encryptionkey@0"
I20260809 18:51:14.613091 15242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "5e15ce546214444d9f751e5078fa5e7d"
format_stamp: "Formatted at 2026-08-09 18:51:14 on dist-test-slave-45dx"
server_key: "66c2998b36dde3c3470071d92ddb6989"
server_key_iv: "a2d933c829f75be8a91e153410b4105c"
server_key_version: "encryptionkey@0"
I20260809 18:51:14.614413 15242 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260809 18:51:14.615146 15265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:14.615300 15242 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:51:14.615401 15242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "5e15ce546214444d9f751e5078fa5e7d"
format_stamp: "Formatted at 2026-08-09 18:51:14 on dist-test-slave-45dx"
server_key: "66c2998b36dde3c3470071d92ddb6989"
server_key_iv: "a2d933c829f75be8a91e153410b4105c"
server_key_version: "encryptionkey@0"
I20260809 18:51:14.615455 15242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:14.631101 15242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:14.633545 15242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:14.633677 15242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:14.637791 15242 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41521
I20260809 18:51:14.637846 15364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41521 every 8 connection(s)
I20260809 18:51:14.638204 15242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:14.639110 15365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:14.641530 15365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d: Bootstrap starting.
I20260809 18:51:14.641870 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 15242
I20260809 18:51:14.642012 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:14.642225 13099 external_mini_cluster.cc:1428] Setting key 4ce8b3a11cf7c9e96d2a5bf307f143a3
I20260809 18:51:14.642234 15365 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:14.642575 15365 log.cc:824] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:14.643440 15365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d: No bootstrap required, opened a new log
I20260809 18:51:14.645417 15365 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e15ce546214444d9f751e5078fa5e7d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41521 } }
I20260809 18:51:14.645629 15365 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:14.645685 15365 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e15ce546214444d9f751e5078fa5e7d, State: Initialized, Role: FOLLOWER
I20260809 18:51:14.645819 15365 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e15ce546214444d9f751e5078fa5e7d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41521 } }
I20260809 18:51:14.645901 15365 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:14.645926 15365 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:14.645964 15365 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:14.646509 15365 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e15ce546214444d9f751e5078fa5e7d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41521 } }
I20260809 18:51:14.646595 15365 leader_election.cc:302] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e15ce546214444d9f751e5078fa5e7d; no voters:
I20260809 18:51:14.646790 15365 leader_election.cc:288] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:14.646893 15375 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:14.647047 15375 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d [term 1 LEADER]: Becoming Leader. State: Replica: 5e15ce546214444d9f751e5078fa5e7d, State: Running, Role: LEADER
I20260809 18:51:14.647104 15365 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:14.647203 15375 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e15ce546214444d9f751e5078fa5e7d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41521 } }
I20260809 18:51:14.647643 15377 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e15ce546214444d9f751e5078fa5e7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e15ce546214444d9f751e5078fa5e7d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41521 } } }
I20260809 18:51:14.647735 15377 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:14.648264 15378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e15ce546214444d9f751e5078fa5e7d. Latest consensus state: current_term: 1 leader_uuid: "5e15ce546214444d9f751e5078fa5e7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e15ce546214444d9f751e5078fa5e7d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41521 } } }
I20260809 18:51:14.648378 15394 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:14.648432 15378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:14.648981 15394 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:14.649304 15372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:14.642753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:47341 (local address 127.0.0.1:41521)
0809 18:51:14.642956 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:14.642964 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:14.642990 (+ 26us) server_negotiation.cc:407] Connection header received
0809 18:51:14.643620 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:14.643629 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:14.643691 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:14.643836 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:14.644043 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:14.646035 (+ 1992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:14.646818 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:14.647459 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:14.647566 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:14.648328 (+ 762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:14.648332 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:14.648333 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:14.648546 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:14.648590 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:14.648606 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:14.648692 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:14.649077 (+ 385us) server_negotiation.cc:299] Negotiation successful
0809 18:51:14.649103 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":96,"threads_started":1}
I20260809 18:51:14.650316 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:14.650609 15394 catalog_manager.cc:1347] Generated new cluster ID: 2b875b03068a42f1a653bc0a56411108
I20260809 18:51:14.650666 15394 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:51:14.654665 15372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:14.651808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:50507 (local address 127.0.0.1:41521)
0809 18:51:14.651851 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:14.651853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:14.652045 (+ 192us) server_negotiation.cc:407] Connection header received
0809 18:51:14.652116 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:14.652118 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:14.652129 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:14.652177 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:14.652357 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:14.652818 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:14.653492 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:14.653718 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:14.653790 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:14.654453 (+ 663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:14.654455 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:14.654455 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:14.654459 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:14.654472 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:14.654476 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:14.654528 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:14.654587 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 18:51:14.654595 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:51:14.655998 15394 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:14.656690 15394 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:14.658805 15394 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e15ce546214444d9f751e5078fa5e7d: Generated new TSK 0
I20260809 18:51:14.658990 15394 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:14.662772 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 15242
W20260809 18:51:14.675483 15221 connection.cc:535] client connection to 127.0.0.1:41521 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41521): Connection reset by peer (error 104)
2026-08-09T18:51:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1573 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:14 dist-test-slave-45dx krb5kdc[15422](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:14 dist-test-slave-45dx krb5kdc[15422](info): set up 2 sockets
Aug 09 18:51:14 dist-test-slave-45dx krb5kdc[15422](info): commencing operation
krb5kdc: starting...
W20260809 18:51:15.893510 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.204s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:15 dist-test-slave-45dx krb5kdc[15422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 18:51:16.009209 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36171
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36171
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:16.089749 15446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:16.089988 15446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:16.090029 15446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:16.091179 15446 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:16.091250 15446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:16.091276 15446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:16.091308 15446 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:16.091332 15446 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:16.092895 15446 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36171
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:16.093174 15446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:16.093402 15446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:16.098595 15456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:16.098567 15457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:16.098644 15460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:16.098680 15446 server_base.cc:1034] running on GCE node
I20260809 18:51:16.099040 15446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:16.099383 15446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:16.100538 15446 hybrid_clock.cc:648] HybridClock initialized: now 1786301476100519 us; error 34 us; skew 500 ppm
Aug 09 18:51:16 dist-test-slave-45dx krb5kdc[15422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301476, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:16.108291 15446 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 18:51:16.108840 15446 webserver.cc:460] Webserver started at http://127.0.0.1:43431/ using document root <none> and password file <none>
I20260809 18:51:16.109104 15446 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:16.109175 15446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:16.109324 15446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:16.110384 15446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "4b5eabb394884b178f41d4740fd04f3f"
format_stamp: "Formatted at 2026-08-09 18:51:16 on dist-test-slave-45dx"
server_key: "30fe785f403b1c0ab788b5eebd472fd0"
server_key_iv: "6cc31e5700d44f0c3d39a3f859a6d370"
server_key_version: "encryptionkey@0"
I20260809 18:51:16.110751 15446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "4b5eabb394884b178f41d4740fd04f3f"
format_stamp: "Formatted at 2026-08-09 18:51:16 on dist-test-slave-45dx"
server_key: "30fe785f403b1c0ab788b5eebd472fd0"
server_key_iv: "6cc31e5700d44f0c3d39a3f859a6d370"
server_key_version: "encryptionkey@0"
I20260809 18:51:16.112097 15446 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 18:51:16.112913 15473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:16.113090 15446 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:16.113195 15446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "4b5eabb394884b178f41d4740fd04f3f"
format_stamp: "Formatted at 2026-08-09 18:51:16 on dist-test-slave-45dx"
server_key: "30fe785f403b1c0ab788b5eebd472fd0"
server_key_iv: "6cc31e5700d44f0c3d39a3f859a6d370"
server_key_version: "encryptionkey@0"
I20260809 18:51:16.113281 15446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:16.116503 15446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:16.118822 15446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:16.118983 15446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:16.123108 15446 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36171
I20260809 18:51:16.123155 15570 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36171 every 8 connection(s)
I20260809 18:51:16.123482 15446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:16.123701 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 15446
I20260809 18:51:16.123837 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:16.124009 13099 external_mini_cluster.cc:1428] Setting key 1ad452756a1136209da29fc4976d05fa
I20260809 18:51:16.124666 15571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:16.126276 15574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:16.124516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:37393 (local address 127.0.0.1:36171)
0809 18:51:16.124680 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:16.124687 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:16.124712 (+ 25us) server_negotiation.cc:407] Connection header received
0809 18:51:16.125155 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:16.125161 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:16.125182 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:16.125281 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:16.125863 (+ 582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:16.125866 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:16.125866 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:16.125870 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:16.125903 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:16.125912 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:16.125962 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:16.126050 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 18:51:16.126098 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":77,"threads_started":1}
I20260809 18:51:16.127329 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:16.127628 15571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f: Bootstrap starting.
I20260809 18:51:16.128369 15571 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:16.128736 15571 log.cc:824] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:16.129495 15571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f: No bootstrap required, opened a new log
I20260809 18:51:16.129987 15574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:16.128943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:47903 (local address 127.0.0.1:36171)
0809 18:51:16.128982 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:16.128984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:16.129110 (+ 126us) server_negotiation.cc:407] Connection header received
0809 18:51:16.129185 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:16.129186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:16.129190 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:16.129245 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:16.129771 (+ 526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:16.129772 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:16.129773 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:16.129777 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:16.129789 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:16.129793 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:16.129837 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:16.129898 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 18:51:16.129911 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:51:16.131413 15571 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b5eabb394884b178f41d4740fd04f3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36171 } }
I20260809 18:51:16.131584 15571 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:16.131634 15571 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5eabb394884b178f41d4740fd04f3f, State: Initialized, Role: FOLLOWER
I20260809 18:51:16.131755 15571 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b5eabb394884b178f41d4740fd04f3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36171 } }
I20260809 18:51:16.131853 15571 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:16.131897 15571 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:16.131947 15571 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:16.132555 15571 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b5eabb394884b178f41d4740fd04f3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36171 } }
I20260809 18:51:16.132685 15571 leader_election.cc:302] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b5eabb394884b178f41d4740fd04f3f; no voters:
I20260809 18:51:16.132864 15571 leader_election.cc:288] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:16.132922 15587 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:16.133095 15587 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f [term 1 LEADER]: Becoming Leader. State: Replica: 4b5eabb394884b178f41d4740fd04f3f, State: Running, Role: LEADER
I20260809 18:51:16.133107 15571 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:16.133198 15587 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b5eabb394884b178f41d4740fd04f3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36171 } }
I20260809 18:51:16.133600 15588 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b5eabb394884b178f41d4740fd04f3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b5eabb394884b178f41d4740fd04f3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36171 } } }
I20260809 18:51:16.133656 15590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b5eabb394884b178f41d4740fd04f3f. Latest consensus state: current_term: 1 leader_uuid: "4b5eabb394884b178f41d4740fd04f3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b5eabb394884b178f41d4740fd04f3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36171 } } }
I20260809 18:51:16.133798 15590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:16.133778 15588 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:16.134102 15601 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:16.134591 15601 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:16.137293 15601 catalog_manager.cc:1347] Generated new cluster ID: 09011eea99ac4a43adf8d38a16367f3b
I20260809 18:51:16.137363 15601 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:51:16.154532 15601 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:16.154724 15601 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:16.163646 15601 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b5eabb394884b178f41d4740fd04f3f: Generated new TSK 0
I20260809 18:51:16.163854 15601 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:16.167596 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 15446
2026-08-09T18:51:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1510 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:16 dist-test-slave-45dx krb5kdc[15618](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:16 dist-test-slave-45dx krb5kdc[15618](info): set up 2 sockets
Aug 09 18:51:16 dist-test-slave-45dx krb5kdc[15618](info): commencing operation
krb5kdc: starting...
W20260809 18:51:17.421092 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:17 dist-test-slave-45dx krb5kdc[15618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 18:51:17.542573 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44583
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:17.624018 15636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:17.624233 15636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:17.624269 15636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:17.625394 15636 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:17.625463 15636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:17.625487 15636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:17.625515 15636 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:17.625543 15636 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:17.626996 15636 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44583
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15636
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:17.627260 15636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:17.627485 15636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:17.632215 15652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:17.632234 15649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:17.632229 15646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:17.632280 15636 server_base.cc:1034] running on GCE node
I20260809 18:51:17.632774 15636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:17.633018 15636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:17.634155 15636 hybrid_clock.cc:648] HybridClock initialized: now 1786301477634147 us; error 33 us; skew 500 ppm
Aug 09 18:51:17 dist-test-slave-45dx krb5kdc[15618](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301477, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:17.636813 15636 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 18:51:17.637283 15636 webserver.cc:460] Webserver started at http://127.0.0.1:42667/ using document root <none> and password file <none>
I20260809 18:51:17.637542 15636 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:17.637589 15636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:17.637761 15636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:17.638777 15636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "e092f03ea6cd4c71901c4e37d041dae4"
format_stamp: "Formatted at 2026-08-09 18:51:17 on dist-test-slave-45dx"
server_key: "6936babcf0f3e86cf4ee435387b21f99"
server_key_iv: "a5c909bc1ce7c1020c513f1c1aa24e38"
server_key_version: "encryptionkey@0"
I20260809 18:51:17.639127 15636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "e092f03ea6cd4c71901c4e37d041dae4"
format_stamp: "Formatted at 2026-08-09 18:51:17 on dist-test-slave-45dx"
server_key: "6936babcf0f3e86cf4ee435387b21f99"
server_key_iv: "a5c909bc1ce7c1020c513f1c1aa24e38"
server_key_version: "encryptionkey@0"
I20260809 18:51:17.640461 15636 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:51:17.641222 15664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:17.641407 15636 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:51:17.641500 15636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "e092f03ea6cd4c71901c4e37d041dae4"
format_stamp: "Formatted at 2026-08-09 18:51:17 on dist-test-slave-45dx"
server_key: "6936babcf0f3e86cf4ee435387b21f99"
server_key_iv: "a5c909bc1ce7c1020c513f1c1aa24e38"
server_key_version: "encryptionkey@0"
I20260809 18:51:17.641592 15636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:17.660651 15636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:17.663101 15636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:17.663275 15636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:17.667670 15636 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44583
I20260809 18:51:17.667752 15741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44583 every 8 connection(s)
I20260809 18:51:17.668095 15636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:17.668985 15743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:17.671311 15743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4: Bootstrap starting.
I20260809 18:51:17.671909 15743 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:17.672215 15743 log.cc:824] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:17.672930 15743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4: No bootstrap required, opened a new log
I20260809 18:51:17.674526 15743 raft_consensus.cc:348] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e092f03ea6cd4c71901c4e37d041dae4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44583 } }
I20260809 18:51:17.674664 15743 raft_consensus.cc:374] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:17.674989 15743 raft_consensus.cc:729] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e092f03ea6cd4c71901c4e37d041dae4, State: Initialized, Role: FOLLOWER
I20260809 18:51:17.675184 15743 consensus_queue.cc:260] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e092f03ea6cd4c71901c4e37d041dae4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44583 } }
I20260809 18:51:17.675266 15743 raft_consensus.cc:388] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:17.675289 15743 raft_consensus.cc:482] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:17.675356 15743 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:17.675928 15743 raft_consensus.cc:504] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e092f03ea6cd4c71901c4e37d041dae4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44583 } }
I20260809 18:51:17.676059 15743 leader_election.cc:302] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e092f03ea6cd4c71901c4e37d041dae4; no voters:
I20260809 18:51:17.676249 15743 leader_election.cc:288] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:17.676282 15748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:17.676497 15748 raft_consensus.cc:686] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4 [term 1 LEADER]: Becoming Leader. State: Replica: e092f03ea6cd4c71901c4e37d041dae4, State: Running, Role: LEADER
I20260809 18:51:17.676626 15743 sys_catalog.cc:564] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:17.676623 15748 consensus_queue.cc:237] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e092f03ea6cd4c71901c4e37d041dae4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44583 } }
I20260809 18:51:17.677058 15749 sys_catalog.cc:455] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e092f03ea6cd4c71901c4e37d041dae4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e092f03ea6cd4c71901c4e37d041dae4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44583 } } }
I20260809 18:51:17.677142 15749 sys_catalog.cc:458] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:17.677301 15753 sys_catalog.cc:455] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e092f03ea6cd4c71901c4e37d041dae4. Latest consensus state: current_term: 1 leader_uuid: "e092f03ea6cd4c71901c4e37d041dae4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e092f03ea6cd4c71901c4e37d041dae4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44583 } } }
I20260809 18:51:17.677680 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 15636
I20260809 18:51:17.677857 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:17.678081 13099 external_mini_cluster.cc:1428] Setting key 431c9096dad9c246dec46979ad9835b3
I20260809 18:51:17.677460 15753 sys_catalog.cc:458] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:17.677553 15757 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:17.679379 15757 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:17.681357 15757 catalog_manager.cc:1347] Generated new cluster ID: 27d5da69d55c405891b9acffa45e494c
I20260809 18:51:17.681399 15757 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 18:51:17 dist-test-slave-45dx krb5kdc[15618](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 18:51:17.689364 15757 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:17.690033 15757 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:17.690114 15774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:17.678616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:38057 (local address 127.0.0.1:44583)
0809 18:51:17.678843 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:17.678853 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:17.678890 (+ 37us) server_negotiation.cc:407] Connection header received
0809 18:51:17.679020 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:17.679028 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:17.679088 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:17.679238 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:17.680088 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:17.681251 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:17.682360 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:17.682966 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:17.683068 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:17.686015 (+ 2947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:17.686018 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:17.686018 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:17.686030 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:17.688059 (+ 2029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:17.688499 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:17.688502 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:17.688502 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:17.688617 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:17.688972 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:17.688973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:17.688973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:17.689320 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:17.689504 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:17.689678 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 18:51:17.689892 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":82,"threads_started":1}
I20260809 18:51:17.691022 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:17.698283 15757 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e092f03ea6cd4c71901c4e37d041dae4: Generated new TSK 0
I20260809 18:51:17.698518 15757 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:17.705015 15774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:17.698431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:34203 (local address 127.0.0.1:44583)
0809 18:51:17.698470 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:17.698472 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:17.698585 (+ 113us) server_negotiation.cc:407] Connection header received
0809 18:51:17.698686 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:17.698687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:17.698698 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:17.698749 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:17.699346 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:17.700233 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:17.700996 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:17.701216 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:17.701292 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:17.702526 (+ 1234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:17.702528 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:17.702528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:17.702535 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:17.703850 (+ 1315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:17.704204 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:17.704205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:17.704206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:17.704262 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:17.704533 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:17.704534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:17.704534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:17.704642 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:17.704762 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:17.704870 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 18:51:17.704928 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:51:17.706835 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 15636
W20260809 18:51:17.722636 15616 connection.cc:535] client connection to 127.0.0.1:44583 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44583): Connection reset by peer (error 104)
2026-08-09T18:51:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1536 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:17 dist-test-slave-45dx krb5kdc[15788](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:17 dist-test-slave-45dx krb5kdc[15788](info): set up 2 sockets
Aug 09 18:51:17 dist-test-slave-45dx krb5kdc[15788](info): commencing operation
krb5kdc: starting...
W20260809 18:51:18.976923 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:19 dist-test-slave-45dx krb5kdc[15788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301479, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 18:51:19.096793 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36287
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36287
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:19.176993 15811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:19.177245 15811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:19.177282 15811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:19.178459 15811 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:19.178539 15811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:19.178563 15811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:19.178592 15811 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:19.178623 15811 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:19.180207 15811 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36287
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15811
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:19.180526 15811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:19.180763 15811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:19.185601 15819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:19.185602 15820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:19.185663 15823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:19.185840 15811 server_base.cc:1034] running on GCE node
I20260809 18:51:19.186246 15811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:19.186583 15811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:19.187749 15811 hybrid_clock.cc:648] HybridClock initialized: now 1786301479187736 us; error 44 us; skew 500 ppm
Aug 09 18:51:19 dist-test-slave-45dx krb5kdc[15788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301479, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:19.190243 15811 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 18:51:19.190717 15811 webserver.cc:460] Webserver started at http://127.0.0.1:36793/ using document root <none> and password file <none>
I20260809 18:51:19.190964 15811 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:19.191036 15811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:19.191190 15811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:19.192230 15811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "21102e969c98491c9f282ca1bf8a408d"
format_stamp: "Formatted at 2026-08-09 18:51:19 on dist-test-slave-45dx"
server_key: "cf117ff1ea6544b14d6d14017c3ead8b"
server_key_iv: "83a58597520493e4031ffe9a1c9cb5ca"
server_key_version: "encryptionkey@0"
I20260809 18:51:19.192664 15811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "21102e969c98491c9f282ca1bf8a408d"
format_stamp: "Formatted at 2026-08-09 18:51:19 on dist-test-slave-45dx"
server_key: "cf117ff1ea6544b14d6d14017c3ead8b"
server_key_iv: "83a58597520493e4031ffe9a1c9cb5ca"
server_key_version: "encryptionkey@0"
I20260809 18:51:19.194111 15811 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:51:19.195014 15839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:19.195268 15811 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:51:19.195400 15811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "21102e969c98491c9f282ca1bf8a408d"
format_stamp: "Formatted at 2026-08-09 18:51:19 on dist-test-slave-45dx"
server_key: "cf117ff1ea6544b14d6d14017c3ead8b"
server_key_iv: "83a58597520493e4031ffe9a1c9cb5ca"
server_key_version: "encryptionkey@0"
I20260809 18:51:19.195490 15811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:19.210216 15811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:19.212285 15811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:19.212548 15811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:19.216892 15811 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36287
I20260809 18:51:19.216924 15923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36287 every 8 connection(s)
I20260809 18:51:19.217299 15811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:19.218146 15924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:19.220448 15924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d: Bootstrap starting.
I20260809 18:51:19.221012 15924 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:19.221305 15924 log.cc:824] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:19.221535 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 15811
I20260809 18:51:19.221688 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:19.221961 13099 external_mini_cluster.cc:1428] Setting key e53b55dbc04f6e9b67473e2b561487a1
I20260809 18:51:19.222110 15924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d: No bootstrap required, opened a new log
I20260809 18:51:19.225083 15924 raft_consensus.cc:348] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21102e969c98491c9f282ca1bf8a408d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36287 } }
I20260809 18:51:19.225251 15924 raft_consensus.cc:374] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:19.225281 15924 raft_consensus.cc:729] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21102e969c98491c9f282ca1bf8a408d, State: Initialized, Role: FOLLOWER
I20260809 18:51:19.225399 15924 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21102e969c98491c9f282ca1bf8a408d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36287 } }
I20260809 18:51:19.225478 15924 raft_consensus.cc:388] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:19.225510 15924 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:19.225564 15924 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:19.226140 15924 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21102e969c98491c9f282ca1bf8a408d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36287 } }
I20260809 18:51:19.226263 15924 leader_election.cc:302] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21102e969c98491c9f282ca1bf8a408d; no voters:
I20260809 18:51:19.226451 15924 leader_election.cc:288] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:19.226522 15933 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:19.226701 15924 sys_catalog.cc:564] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:19.226734 15933 raft_consensus.cc:686] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d [term 1 LEADER]: Becoming Leader. State: Replica: 21102e969c98491c9f282ca1bf8a408d, State: Running, Role: LEADER
I20260809 18:51:19.226943 15933 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21102e969c98491c9f282ca1bf8a408d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36287 } }
I20260809 18:51:19.227511 15934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21102e969c98491c9f282ca1bf8a408d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21102e969c98491c9f282ca1bf8a408d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36287 } } }
I20260809 18:51:19.227530 15935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21102e969c98491c9f282ca1bf8a408d. Latest consensus state: current_term: 1 leader_uuid: "21102e969c98491c9f282ca1bf8a408d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21102e969c98491c9f282ca1bf8a408d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36287 } } }
I20260809 18:51:19.227618 15934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:19.227630 15935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:19.227849 15944 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:19.228434 15944 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:19.229528 15929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:19.222500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:39709 (local address 127.0.0.1:36287)
0809 18:51:19.222718 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:19.222728 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:19.222766 (+ 38us) server_negotiation.cc:407] Connection header received
0809 18:51:19.223515 (+ 749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:19.223523 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:19.223601 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:19.223749 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:19.224052 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:19.225490 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:19.226430 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:19.227057 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:19.227176 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:19.228866 (+ 1690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:19.228870 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:19.228871 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:19.229038 (+ 167us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:19.229068 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:19.229079 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:19.229175 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:19.229256 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 18:51:19.229284 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":87,"threads_started":1}
I20260809 18:51:19.230192 15944 catalog_manager.cc:1347] Generated new cluster ID: ca3e6daee63e47789eda5fc74d544a41
I20260809 18:51:19.230247 15944 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:51:19.230648 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:19.235983 15929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:19.232137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:59025 (local address 127.0.0.1:36287)
0809 18:51:19.232172 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:19.232174 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:19.232352 (+ 178us) server_negotiation.cc:407] Connection header received
0809 18:51:19.232433 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:19.232433 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:19.232443 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:19.232492 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:19.232642 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:19.233343 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:19.234507 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:19.234814 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:19.234874 (+ 60us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:19.235686 (+ 812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:19.235687 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:19.235688 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:19.235692 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:19.235706 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:19.235711 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:19.235767 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:19.235902 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 18:51:19.235913 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 18:51:19.244241 15944 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:19.244969 15944 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:19.253455 15944 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 21102e969c98491c9f282ca1bf8a408d: Generated new TSK 0
I20260809 18:51:19.253633 15944 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:19.257150 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 15811
W20260809 18:51:19.269207 15786 connection.cc:535] client connection to 127.0.0.1:36287 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36287): Connection reset by peer (error 104)
2026-08-09T18:51:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1546 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:19 dist-test-slave-45dx krb5kdc[15964](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:19 dist-test-slave-45dx krb5kdc[15964](info): set up 2 sockets
Aug 09 18:51:19 dist-test-slave-45dx krb5kdc[15964](info): commencing operation
krb5kdc: starting...
W20260809 18:51:20.489955 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.207s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:20 dist-test-slave-45dx krb5kdc[15964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301480, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 18:51:20.614722 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36519
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36519
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:20.692706 15985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:20.692900 15985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:20.692922 15985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:20.694020 15985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:20.694056 15985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:20.694069 15985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:20.694082 15985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:20.694093 15985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:20.695492 15985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36519
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:20.695679 15985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:20.695842 15985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:20.700691 15995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:20.700713 15992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:20.700767 15997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:20.701182 15985 server_base.cc:1034] running on GCE node
I20260809 18:51:20.701431 15985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:20.701726 15985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:20.702881 15985 hybrid_clock.cc:648] HybridClock initialized: now 1786301480702867 us; error 31 us; skew 500 ppm
Aug 09 18:51:20 dist-test-slave-45dx krb5kdc[15964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301480, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:20.705441 15985 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 18:51:20.705835 15985 webserver.cc:460] Webserver started at http://127.0.0.1:46459/ using document root <none> and password file <none>
I20260809 18:51:20.706081 15985 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:20.706156 15985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:20.706321 15985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:20.707436 15985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "7417efa0fb6b4868ac8622e1cdad86ef"
format_stamp: "Formatted at 2026-08-09 18:51:20 on dist-test-slave-45dx"
server_key: "662290e0fd1c226d49c78941b733e876"
server_key_iv: "f9bee11db618f292d5ebb84d1fbe177e"
server_key_version: "encryptionkey@0"
I20260809 18:51:20.707842 15985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "7417efa0fb6b4868ac8622e1cdad86ef"
format_stamp: "Formatted at 2026-08-09 18:51:20 on dist-test-slave-45dx"
server_key: "662290e0fd1c226d49c78941b733e876"
server_key_iv: "f9bee11db618f292d5ebb84d1fbe177e"
server_key_version: "encryptionkey@0"
I20260809 18:51:20.709335 15985 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:51:20.710139 16008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:20.710325 15985 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:51:20.710444 15985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "7417efa0fb6b4868ac8622e1cdad86ef"
format_stamp: "Formatted at 2026-08-09 18:51:20 on dist-test-slave-45dx"
server_key: "662290e0fd1c226d49c78941b733e876"
server_key_iv: "f9bee11db618f292d5ebb84d1fbe177e"
server_key_version: "encryptionkey@0"
I20260809 18:51:20.710526 15985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:20.714134 15985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:20.716729 15985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:20.716895 15985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:20.721051 15985 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36519
I20260809 18:51:20.721081 16091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36519 every 8 connection(s)
I20260809 18:51:20.721395 15985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:20.722388 16092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:20.724654 16092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef: Bootstrap starting.
I20260809 18:51:20.725247 16092 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:20.725551 16092 log.cc:824] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:20.726248 16092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef: No bootstrap required, opened a new log
I20260809 18:51:20.727857 16092 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7417efa0fb6b4868ac8622e1cdad86ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36519 } }
I20260809 18:51:20.727988 16092 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:20.728010 16092 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7417efa0fb6b4868ac8622e1cdad86ef, State: Initialized, Role: FOLLOWER
I20260809 18:51:20.728174 16092 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7417efa0fb6b4868ac8622e1cdad86ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36519 } }
I20260809 18:51:20.728237 16092 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:20.728258 16092 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:20.728354 16092 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:20.728909 16092 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7417efa0fb6b4868ac8622e1cdad86ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36519 } }
I20260809 18:51:20.729024 16092 leader_election.cc:302] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7417efa0fb6b4868ac8622e1cdad86ef; no voters:
I20260809 18:51:20.729239 16092 leader_election.cc:288] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:20.729274 16096 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:20.729395 16096 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef [term 1 LEADER]: Becoming Leader. State: Replica: 7417efa0fb6b4868ac8622e1cdad86ef, State: Running, Role: LEADER
I20260809 18:51:20.729387 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 15985
I20260809 18:51:20.729497 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:20.729539 16092 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:20.729542 16096 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7417efa0fb6b4868ac8622e1cdad86ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36519 } }
I20260809 18:51:20.729679 13099 external_mini_cluster.cc:1428] Setting key 4c08bacad736084763eda36b9d19c25c
I20260809 18:51:20.729964 16098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7417efa0fb6b4868ac8622e1cdad86ef. Latest consensus state: current_term: 1 leader_uuid: "7417efa0fb6b4868ac8622e1cdad86ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7417efa0fb6b4868ac8622e1cdad86ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36519 } } }
I20260809 18:51:20.730057 16098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:20.730086 16097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7417efa0fb6b4868ac8622e1cdad86ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7417efa0fb6b4868ac8622e1cdad86ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36519 } } }
I20260809 18:51:20.730146 16097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:20.730564 16102 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:20.731786 16102 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:20.732194 16103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:20.730315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:56443 (local address 127.0.0.1:36519)
0809 18:51:20.730553 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:20.730564 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:20.730611 (+ 47us) server_negotiation.cc:407] Connection header received
0809 18:51:20.730743 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:20.730751 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:20.730788 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:20.730942 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:20.731620 (+ 678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:20.731624 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:20.731624 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:20.731629 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:20.731668 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:20.731683 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:20.731743 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:20.731867 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 18:51:20.732014 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":106,"threads_started":1}
I20260809 18:51:20.733148 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:20.733952 16102 catalog_manager.cc:1347] Generated new cluster ID: cde66af26bd74a9f9d13f9c87f3cc869
I20260809 18:51:20.733994 16102 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:51:20.735929 16103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:20.734773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.37:50235 (local address 127.0.0.1:36519)
0809 18:51:20.734803 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:20.734805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:20.735010 (+ 205us) server_negotiation.cc:407] Connection header received
0809 18:51:20.735075 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:20.735075 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:20.735080 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:20.735134 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:20.735742 (+ 608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:20.735743 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:20.735743 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:20.735746 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:20.735756 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:20.735760 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:20.735807 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:20.735862 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 18:51:20.735873 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260809 18:51:20.753084 16102 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:20.753309 16102 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:20.767474 16102 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7417efa0fb6b4868ac8622e1cdad86ef: Generated new TSK 0
I20260809 18:51:20.767674 16102 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:20.775772 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 15985
2026-08-09T18:51:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1524 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:20 dist-test-slave-45dx krb5kdc[16138](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:20 dist-test-slave-45dx krb5kdc[16138](info): set up 2 sockets
Aug 09 18:51:20 dist-test-slave-45dx krb5kdc[16138](info): commencing operation
krb5kdc: starting...
W20260809 18:51:22.045727 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:22 dist-test-slave-45dx krb5kdc[16138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301482, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:51:22.166505 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:45279
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:38557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:45279
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:22.248452 16158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:22.248648 16158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:22.248670 16158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:22.249806 16158 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:22.249848 16158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:22.249862 16158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:22.249874 16158 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:22.249909 16158 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:22.251374 16158 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:38557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:45279
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:45279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16158
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:22.251623 16158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:22.251842 16158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:22.256692 16169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:22.256733 16166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:22.256819 16158 server_base.cc:1034] running on GCE node
W20260809 18:51:22.256707 16164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:22.257107 16158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:22.257400 16158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:22.258565 16158 hybrid_clock.cc:648] HybridClock initialized: now 1786301482258559 us; error 35 us; skew 500 ppm
Aug 09 18:51:22 dist-test-slave-45dx krb5kdc[16138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301482, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:22.261199 16158 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:51:22.261821 16158 webserver.cc:460] Webserver started at http://127.12.202.254:42789/ using document root <none> and password file <none>
I20260809 18:51:22.262094 16158 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:22.262140 16158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:22.262298 16158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:22.263947 16158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "639008ac49ab4107a412e343a02fd710"
format_stamp: "Formatted at 2026-08-09 18:51:22 on dist-test-slave-45dx"
server_key: "246159262bd4c84518b96521548cde17"
server_key_iv: "ed5068ae4860c4edb8362a4a2b944e3b"
server_key_version: "encryptionkey@0"
I20260809 18:51:22.264433 16158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "639008ac49ab4107a412e343a02fd710"
format_stamp: "Formatted at 2026-08-09 18:51:22 on dist-test-slave-45dx"
server_key: "246159262bd4c84518b96521548cde17"
server_key_iv: "ed5068ae4860c4edb8362a4a2b944e3b"
server_key_version: "encryptionkey@0"
I20260809 18:51:22.266217 16158 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 18:51:22.267403 16179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:22.267611 16158 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:51:22.267730 16158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "639008ac49ab4107a412e343a02fd710"
format_stamp: "Formatted at 2026-08-09 18:51:22 on dist-test-slave-45dx"
server_key: "246159262bd4c84518b96521548cde17"
server_key_iv: "ed5068ae4860c4edb8362a4a2b944e3b"
server_key_version: "encryptionkey@0"
I20260809 18:51:22.267812 16158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:22.283751 16158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:22.285686 16158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:22.285804 16158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:22.289924 16158 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:45279
I20260809 18:51:22.290010 16262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:45279 every 8 connection(s)
I20260809 18:51:22.290364 16158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:22.291240 16263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:22.291697 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 16158
I20260809 18:51:22.291843 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:22.292078 13099 external_mini_cluster.cc:1428] Setting key 0e4b730c01fee26f32934f0b7ea6f43d
I20260809 18:51:22.294200 16263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710: Bootstrap starting.
I20260809 18:51:22.294818 16263 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:22.295115 16263 log.cc:824] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:22.295938 16263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710: No bootstrap required, opened a new log
I20260809 18:51:22.298585 16263 raft_consensus.cc:348] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "639008ac49ab4107a412e343a02fd710" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45279 } }
I20260809 18:51:22.298770 16263 raft_consensus.cc:374] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:22.298800 16263 raft_consensus.cc:729] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 639008ac49ab4107a412e343a02fd710, State: Initialized, Role: FOLLOWER
I20260809 18:51:22.298945 16263 consensus_queue.cc:260] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "639008ac49ab4107a412e343a02fd710" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45279 } }
I20260809 18:51:22.299016 16263 raft_consensus.cc:388] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:22.299037 16263 raft_consensus.cc:482] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:22.299103 16263 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710 [term 0 FOLLOWER]: Advancing to term 1
Aug 09 18:51:22 dist-test-slave-45dx krb5kdc[16138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301482, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:51:22.299733 16263 raft_consensus.cc:504] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "639008ac49ab4107a412e343a02fd710" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45279 } }
I20260809 18:51:22.299853 16263 leader_election.cc:302] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 639008ac49ab4107a412e343a02fd710; no voters:
I20260809 18:51:22.300015 16263 leader_election.cc:288] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:22.300068 16268 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:22.300210 16268 raft_consensus.cc:686] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710 [term 1 LEADER]: Becoming Leader. State: Replica: 639008ac49ab4107a412e343a02fd710, State: Running, Role: LEADER
I20260809 18:51:22.300290 16263 sys_catalog.cc:564] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:22.300292 16268 consensus_queue.cc:237] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "639008ac49ab4107a412e343a02fd710" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45279 } }
I20260809 18:51:22.300678 16268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "639008ac49ab4107a412e343a02fd710" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "639008ac49ab4107a412e343a02fd710" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45279 } } }
I20260809 18:51:22.300760 16268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:22.301082 16279 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:22.300729 16273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 639008ac49ab4107a412e343a02fd710. Latest consensus state: current_term: 1 leader_uuid: "639008ac49ab4107a412e343a02fd710" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "639008ac49ab4107a412e343a02fd710" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 45279 } } }
I20260809 18:51:22.301400 16273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:22.301656 16279 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:22.304211 16279 catalog_manager.cc:1347] Generated new cluster ID: 6e35c4f50ec4472c8e58e0639aacee80
I20260809 18:51:22.304263 16279 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:51:22.304768 16266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:22.292695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55261 (local address 127.12.202.254:45279)
0809 18:51:22.292922 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:22.292929 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:22.292955 (+ 26us) server_negotiation.cc:407] Connection header received
0809 18:51:22.293363 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:22.293369 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:22.293412 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:22.293553 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:22.294254 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:22.295303 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:22.296406 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:22.296805 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:22.296907 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:22.299920 (+ 3013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:22.299924 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:22.299924 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:22.299959 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:22.302692 (+ 2733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:22.303151 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:22.303154 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:22.303155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:22.303271 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:22.303541 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:22.303542 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:22.303543 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:22.303845 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:22.304383 (+ 538us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:22.304473 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 18:51:22.304575 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":84,"threads_started":1}
I20260809 18:51:22.305778 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:22.315397 16266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:22.307131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39557 (local address 127.12.202.254:45279)
0809 18:51:22.307162 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:22.307164 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:22.308546 (+ 1382us) server_negotiation.cc:407] Connection header received
0809 18:51:22.308612 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:22.308613 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:22.308624 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:22.308675 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:22.309234 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:22.309951 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:22.310877 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:22.311194 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:22.311263 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:22.312582 (+ 1319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:22.312584 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:22.312584 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:22.312592 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:22.314182 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:22.314590 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:22.314591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:22.314591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:22.314653 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:22.314895 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:22.314896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:22.314896 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:22.315035 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:22.315150 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:22.315252 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 18:51:22.315312 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260809 18:51:22.317029 16279 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:22.317704 16279 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:22.323097 16279 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 639008ac49ab4107a412e343a02fd710: Generated new TSK 0
I20260809 18:51:22.323323 16279 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:22.326563 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 16158
W20260809 18:51:22.347970 16135 connection.cc:535] client connection to 127.12.202.254:45279 recv error: Network error: failed to read from TLS socket (remote: 127.12.202.254:45279): Connection reset by peer (error 104)
2026-08-09T18:51:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1554 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:22 dist-test-slave-45dx krb5kdc[16309](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:22 dist-test-slave-45dx krb5kdc[16309](info): set up 2 sockets
Aug 09 18:51:22 dist-test-slave-45dx krb5kdc[16309](info): commencing operation
krb5kdc: starting...
W20260809 18:51:23.599653 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:23 dist-test-slave-45dx krb5kdc[16309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:51:23.712631 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:37503
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:39623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:37503
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:23.792366 16330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:23.792615 16330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:23.792654 16330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:23.793816 16330 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:23.793907 16330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:23.793932 16330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:23.793959 16330 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:23.793987 16330 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:23.795459 16330 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:39623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:37503
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:37503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:23.795746 16330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:23.795984 16330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:23.800979 16336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:23.800994 16341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:23.801205 16330 server_base.cc:1034] running on GCE node
W20260809 18:51:23.800994 16337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:23.801529 16330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:23.801873 16330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:23.803043 16330 hybrid_clock.cc:648] HybridClock initialized: now 1786301483803040 us; error 38 us; skew 500 ppm
Aug 09 18:51:23 dist-test-slave-45dx krb5kdc[16309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301483, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:23.805552 16330 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:51:23.806025 16330 webserver.cc:460] Webserver started at http://127.12.202.254:46477/ using document root <none> and password file <none>
I20260809 18:51:23.806247 16330 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:23.806313 16330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:23.806466 16330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:23.807499 16330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "12209844d8ed463e9da65e2a7cc63d09"
format_stamp: "Formatted at 2026-08-09 18:51:23 on dist-test-slave-45dx"
server_key: "08f6f695cec11b6811c36b17eb0addc1"
server_key_iv: "a57a03ba8d4a713d4a90d67aba4a8b5e"
server_key_version: "encryptionkey@0"
I20260809 18:51:23.807863 16330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "12209844d8ed463e9da65e2a7cc63d09"
format_stamp: "Formatted at 2026-08-09 18:51:23 on dist-test-slave-45dx"
server_key: "08f6f695cec11b6811c36b17eb0addc1"
server_key_iv: "a57a03ba8d4a713d4a90d67aba4a8b5e"
server_key_version: "encryptionkey@0"
I20260809 18:51:23.809274 16330 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:51:23.810034 16354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:23.810209 16330 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 18:51:23.810321 16330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "12209844d8ed463e9da65e2a7cc63d09"
format_stamp: "Formatted at 2026-08-09 18:51:23 on dist-test-slave-45dx"
server_key: "08f6f695cec11b6811c36b17eb0addc1"
server_key_iv: "a57a03ba8d4a713d4a90d67aba4a8b5e"
server_key_version: "encryptionkey@0"
I20260809 18:51:23.810400 16330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:23.824241 16330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:23.825973 16330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:23.826131 16330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:23.830381 16330 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:37503
I20260809 18:51:23.830413 16434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:37503 every 8 connection(s)
I20260809 18:51:23.830765 16330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:23.831620 16435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:23.834002 16435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09: Bootstrap starting.
I20260809 18:51:23.834599 16435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:23.834900 16435 log.cc:824] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:23.835601 16435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09: No bootstrap required, opened a new log
I20260809 18:51:23.837118 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 16330
I20260809 18:51:23.837222 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:23.837419 13099 external_mini_cluster.cc:1428] Setting key 22dcdcbfe4eb31423be9413dc120f7eb
I20260809 18:51:23.837396 16435 raft_consensus.cc:348] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12209844d8ed463e9da65e2a7cc63d09" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 37503 } }
I20260809 18:51:23.837590 16435 raft_consensus.cc:374] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:23.837641 16435 raft_consensus.cc:729] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12209844d8ed463e9da65e2a7cc63d09, State: Initialized, Role: FOLLOWER
I20260809 18:51:23.837816 16435 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12209844d8ed463e9da65e2a7cc63d09" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 37503 } }
I20260809 18:51:23.837936 16435 raft_consensus.cc:388] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:23.837984 16435 raft_consensus.cc:482] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:23.838073 16435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:23.839239 16435 raft_consensus.cc:504] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12209844d8ed463e9da65e2a7cc63d09" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 37503 } }
I20260809 18:51:23.839362 16435 leader_election.cc:302] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 12209844d8ed463e9da65e2a7cc63d09; no voters:
I20260809 18:51:23.839555 16435 leader_election.cc:288] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:23.839628 16445 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:23.839828 16445 raft_consensus.cc:686] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09 [term 1 LEADER]: Becoming Leader. State: Replica: 12209844d8ed463e9da65e2a7cc63d09, State: Running, Role: LEADER
I20260809 18:51:23.839825 16435 sys_catalog.cc:564] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:23.839978 16445 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12209844d8ed463e9da65e2a7cc63d09" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 37503 } }
I20260809 18:51:23.840448 16448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "12209844d8ed463e9da65e2a7cc63d09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12209844d8ed463e9da65e2a7cc63d09" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 37503 } } }
I20260809 18:51:23.840571 16448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:23.840757 16453 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12209844d8ed463e9da65e2a7cc63d09. Latest consensus state: current_term: 1 leader_uuid: "12209844d8ed463e9da65e2a7cc63d09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12209844d8ed463e9da65e2a7cc63d09" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 37503 } } }
I20260809 18:51:23.840829 16453 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:23.841183 16463 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:23.841719 16463 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:23.843465 16463 catalog_manager.cc:1347] Generated new cluster ID: ede18e670c5b40c9a3a43a682a5bf266
I20260809 18:51:23.843569 16463 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:51:23.843802 16444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:23.837949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36663 (local address 127.12.202.254:37503)
0809 18:51:23.838153 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:23.838163 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:23.838256 (+ 93us) server_negotiation.cc:407] Connection header received
0809 18:51:23.838415 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:23.838421 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:23.838470 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:23.838577 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:23.838907 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:23.840127 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:23.841380 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:23.842011 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:23.842130 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:23.843060 (+ 930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:23.843064 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:23.843064 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:23.843282 (+ 218us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:23.843321 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:23.843336 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:23.843419 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:23.843560 (+ 141us) server_negotiation.cc:299] Negotiation successful
0809 18:51:23.843589 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":96,"threads_started":1}
I20260809 18:51:23.844961 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:23.850567 16444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:23.846580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38095 (local address 127.12.202.254:37503)
0809 18:51:23.846623 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:23.846624 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:23.846751 (+ 127us) server_negotiation.cc:407] Connection header received
0809 18:51:23.846782 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:23.846783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:23.846806 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:23.846874 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:23.847029 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:23.847825 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:23.848851 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:23.849492 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:23.849572 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:23.850307 (+ 735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:23.850309 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:23.850309 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:23.850314 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:23.850331 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:23.850336 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:23.850401 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:23.850470 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 18:51:23.850487 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:51:23.863164 16463 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:23.863921 16463 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:23.869771 16463 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 12209844d8ed463e9da65e2a7cc63d09: Generated new TSK 0
I20260809 18:51:23.869952 16463 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:23.873744 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 16330
W20260809 18:51:23.885953 16307 connection.cc:535] client connection to 127.12.202.254:37503 recv error: Network error: failed to read from TLS socket (remote: 127.12.202.254:37503): Connection reset by peer (error 104)
2026-08-09T18:51:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1537 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:23 dist-test-slave-45dx krb5kdc[16485](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:23 dist-test-slave-45dx krb5kdc[16485](info): set up 2 sockets
Aug 09 18:51:23 dist-test-slave-45dx krb5kdc[16485](info): commencing operation
krb5kdc: starting...
W20260809 18:51:25.123268 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:25 dist-test-slave-45dx krb5kdc[16485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:51:25.244666 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:44011
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:39685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:44011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:25.328197 16506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:25.328474 16506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:25.328516 16506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:25.329692 16506 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:25.329759 16506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:25.329787 16506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:25.329807 16506 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:25.329829 16506 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:25.331470 16506 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:39685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:44011
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:44011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:25.331763 16506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:25.331998 16506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:25.337113 16515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:25.337090 16517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:25.337077 16514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:25.337368 16506 server_base.cc:1034] running on GCE node
I20260809 18:51:25.337697 16506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:25.338029 16506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:25.339206 16506 hybrid_clock.cc:648] HybridClock initialized: now 1786301485339180 us; error 64 us; skew 500 ppm
Aug 09 18:51:25 dist-test-slave-45dx krb5kdc[16485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301485, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:25.341987 16506 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:51:25.342465 16506 webserver.cc:460] Webserver started at http://127.12.202.254:40477/ using document root <none> and password file <none>
I20260809 18:51:25.342728 16506 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:25.342801 16506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:25.342964 16506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:25.344100 16506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "6d59fcf6a4a1494388c8e5e1286a5a1e"
format_stamp: "Formatted at 2026-08-09 18:51:25 on dist-test-slave-45dx"
server_key: "6dfecc931eb327e1945d909a74ec31ea"
server_key_iv: "82f983b0da8dc147ee1fe16b80bd73da"
server_key_version: "encryptionkey@0"
I20260809 18:51:25.344506 16506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "6d59fcf6a4a1494388c8e5e1286a5a1e"
format_stamp: "Formatted at 2026-08-09 18:51:25 on dist-test-slave-45dx"
server_key: "6dfecc931eb327e1945d909a74ec31ea"
server_key_iv: "82f983b0da8dc147ee1fe16b80bd73da"
server_key_version: "encryptionkey@0"
I20260809 18:51:25.346004 16506 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 18:51:25.346841 16528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:25.347066 16506 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:51:25.347182 16506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "6d59fcf6a4a1494388c8e5e1286a5a1e"
format_stamp: "Formatted at 2026-08-09 18:51:25 on dist-test-slave-45dx"
server_key: "6dfecc931eb327e1945d909a74ec31ea"
server_key_iv: "82f983b0da8dc147ee1fe16b80bd73da"
server_key_version: "encryptionkey@0"
I20260809 18:51:25.347262 16506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:25.350704 16506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:25.352772 16506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:25.352938 16506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:25.356884 16506 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:44011
I20260809 18:51:25.356917 16605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:44011 every 8 connection(s)
I20260809 18:51:25.357259 16506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:25.358306 16606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:25.360452 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 16506
I20260809 18:51:25.360575 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:25.360666 16606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e: Bootstrap starting.
I20260809 18:51:25.360792 13099 external_mini_cluster.cc:1428] Setting key 47d4e6b934990dcbbe77bab05ec61bc0
I20260809 18:51:25.361424 16606 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:25.361891 16606 log.cc:824] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:25.362663 16606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e: No bootstrap required, opened a new log
I20260809 18:51:25.363618 16609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:25.361346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42231 (local address 127.12.202.254:44011)
0809 18:51:25.361580 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:25.361589 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:25.361629 (+ 40us) server_negotiation.cc:407] Connection header received
0809 18:51:25.362263 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:25.362271 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:25.362326 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:25.362479 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:25.363170 (+ 691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:25.363174 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:25.363174 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:25.363180 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:25.363226 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:25.363240 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:25.363348 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:25.363381 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 18:51:25.363433 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":105,"threads_started":1}
I20260809 18:51:25.364758 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:25.365159 16606 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d59fcf6a4a1494388c8e5e1286a5a1e" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 44011 } }
I20260809 18:51:25.365288 16606 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:25.365314 16606 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d59fcf6a4a1494388c8e5e1286a5a1e, State: Initialized, Role: FOLLOWER
I20260809 18:51:25.365451 16606 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d59fcf6a4a1494388c8e5e1286a5a1e" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 44011 } }
I20260809 18:51:25.365538 16606 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:25.365583 16606 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:25.365631 16606 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:25.366441 16606 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d59fcf6a4a1494388c8e5e1286a5a1e" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 44011 } }
I20260809 18:51:25.366557 16606 leader_election.cc:302] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d59fcf6a4a1494388c8e5e1286a5a1e; no voters:
I20260809 18:51:25.366719 16606 leader_election.cc:288] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:25.366750 16623 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:25.366918 16623 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e [term 1 LEADER]: Becoming Leader. State: Replica: 6d59fcf6a4a1494388c8e5e1286a5a1e, State: Running, Role: LEADER
I20260809 18:51:25.367244 16623 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d59fcf6a4a1494388c8e5e1286a5a1e" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 44011 } }
I20260809 18:51:25.367372 16609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:25.366200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43853 (local address 127.12.202.254:44011)
0809 18:51:25.366235 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:25.366237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:25.366387 (+ 150us) server_negotiation.cc:407] Connection header received
0809 18:51:25.366414 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:25.366415 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:25.366421 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:25.366488 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:25.367132 (+ 644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:25.367133 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:25.367133 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:25.367137 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:25.367151 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:25.367155 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:25.367213 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:25.367277 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 18:51:25.367290 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 18:51:25.366998 16606 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:25.367681 16625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d59fcf6a4a1494388c8e5e1286a5a1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d59fcf6a4a1494388c8e5e1286a5a1e" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 44011 } } }
I20260809 18:51:25.367764 16625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:25.368005 16628 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:25.368125 16626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d59fcf6a4a1494388c8e5e1286a5a1e. Latest consensus state: current_term: 1 leader_uuid: "6d59fcf6a4a1494388c8e5e1286a5a1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d59fcf6a4a1494388c8e5e1286a5a1e" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 44011 } } }
I20260809 18:51:25.368252 16626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:25.368651 16628 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:25.370246 16628 catalog_manager.cc:1347] Generated new cluster ID: 5a2c0ca4560341f2bc69b3c62c225bef
I20260809 18:51:25.370306 16628 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:51:25.379626 16628 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:25.379815 16628 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:25.395999 16628 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6d59fcf6a4a1494388c8e5e1286a5a1e: Generated new TSK 0
I20260809 18:51:25.396251 16628 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:25.404790 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 16506
2026-08-09T18:51:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1528 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:25 dist-test-slave-45dx krb5kdc[16658](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:25 dist-test-slave-45dx krb5kdc[16658](info): set up 2 sockets
Aug 09 18:51:25 dist-test-slave-45dx krb5kdc[16658](info): commencing operation
krb5kdc: starting...
W20260809 18:51:26.663023 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:26 dist-test-slave-45dx krb5kdc[16658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:51:26.784999 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:39059
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:46485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:39059
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:26.865968 16684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:26.866169 16684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:26.866191 16684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:26.867288 16684 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:26.867319 16684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:26.867333 16684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:26.867345 16684 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:26.867357 16684 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:26.868741 16684 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:46485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:39059
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:39059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16684
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:26.868918 16684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:26.869071 16684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:26.873611 16691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:26.873622 16689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:26.873677 16684 server_base.cc:1034] running on GCE node
W20260809 18:51:26.873629 16694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:26.874023 16684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:26.874331 16684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:26.875492 16684 hybrid_clock.cc:648] HybridClock initialized: now 1786301486875483 us; error 48 us; skew 500 ppm
Aug 09 18:51:26 dist-test-slave-45dx krb5kdc[16658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301486, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:26.877925 16684 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:51:26.878293 16684 webserver.cc:460] Webserver started at http://127.12.202.254:34487/ using document root <none> and password file <none>
I20260809 18:51:26.878463 16684 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:26.878501 16684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:26.878583 16684 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:26.879547 16684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "42c816da91754b398b858392ed8b77bd"
format_stamp: "Formatted at 2026-08-09 18:51:26 on dist-test-slave-45dx"
server_key: "8478d6c4ebd86e3ea48f62d98c250add"
server_key_iv: "788926a3dd8f6decbc125678fece1db0"
server_key_version: "encryptionkey@0"
I20260809 18:51:26.879920 16684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "42c816da91754b398b858392ed8b77bd"
format_stamp: "Formatted at 2026-08-09 18:51:26 on dist-test-slave-45dx"
server_key: "8478d6c4ebd86e3ea48f62d98c250add"
server_key_iv: "788926a3dd8f6decbc125678fece1db0"
server_key_version: "encryptionkey@0"
I20260809 18:51:26.881223 16684 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:51:26.881913 16705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:26.882086 16684 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:51:26.882179 16684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "42c816da91754b398b858392ed8b77bd"
format_stamp: "Formatted at 2026-08-09 18:51:26 on dist-test-slave-45dx"
server_key: "8478d6c4ebd86e3ea48f62d98c250add"
server_key_iv: "788926a3dd8f6decbc125678fece1db0"
server_key_version: "encryptionkey@0"
I20260809 18:51:26.882243 16684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:26.895434 16684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:26.897533 16684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:26.897688 16684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:26.901808 16684 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:39059
I20260809 18:51:26.901850 16795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:39059 every 8 connection(s)
I20260809 18:51:26.902213 16684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:26.903064 16797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:26.905411 16797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd: Bootstrap starting.
I20260809 18:51:26.906005 16797 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:26.906293 16797 log.cc:824] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:26.907013 16797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd: No bootstrap required, opened a new log
I20260809 18:51:26.908607 16797 raft_consensus.cc:348] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42c816da91754b398b858392ed8b77bd" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39059 } }
I20260809 18:51:26.908739 16797 raft_consensus.cc:374] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:26.908761 16797 raft_consensus.cc:729] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c816da91754b398b858392ed8b77bd, State: Initialized, Role: FOLLOWER
I20260809 18:51:26.908946 16797 consensus_queue.cc:260] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42c816da91754b398b858392ed8b77bd" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39059 } }
I20260809 18:51:26.909008 16797 raft_consensus.cc:388] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:26.909045 16797 raft_consensus.cc:482] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:26.909093 16797 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:26.909925 16797 raft_consensus.cc:504] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42c816da91754b398b858392ed8b77bd" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39059 } }
I20260809 18:51:26.910012 16797 leader_election.cc:302] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 42c816da91754b398b858392ed8b77bd; no voters:
I20260809 18:51:26.910216 16797 leader_election.cc:288] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:26.910252 16800 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:26.910274 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 16684
I20260809 18:51:26.910399 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:26.910455 16800 raft_consensus.cc:686] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd [term 1 LEADER]: Becoming Leader. State: Replica: 42c816da91754b398b858392ed8b77bd, State: Running, Role: LEADER
I20260809 18:51:26.910488 16797 sys_catalog.cc:564] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:26.910555 16800 consensus_queue.cc:237] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42c816da91754b398b858392ed8b77bd" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39059 } }
I20260809 18:51:26.910605 13099 external_mini_cluster.cc:1428] Setting key ae52fceec1f244148ea548f3a60f20f7
I20260809 18:51:26.910924 16801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "42c816da91754b398b858392ed8b77bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42c816da91754b398b858392ed8b77bd" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39059 } } }
I20260809 18:51:26.911010 16801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:26.911244 16802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42c816da91754b398b858392ed8b77bd. Latest consensus state: current_term: 1 leader_uuid: "42c816da91754b398b858392ed8b77bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42c816da91754b398b858392ed8b77bd" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 39059 } } }
I20260809 18:51:26.911548 16802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:26.911708 16812 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:26.912262 16812 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:26.914605 16812 catalog_manager.cc:1347] Generated new cluster ID: 398f098bfb8b42e9b3b4ff60c16958b2
I20260809 18:51:26.914660 16812 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:51:26.918515 16812 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:26.919173 16812 catalog_manager.cc:1504] Loading token signing keys...
Aug 09 18:51:26 dist-test-slave-45dx krb5kdc[16658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:51:26.923635 16818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:26.911291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39897 (local address 127.12.202.254:39059)
0809 18:51:26.911469 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:26.911478 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:26.911785 (+ 307us) server_negotiation.cc:407] Connection header received
0809 18:51:26.911933 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:26.911940 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:26.912013 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:26.912153 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:26.913199 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:26.914170 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:26.917012 (+ 2842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:26.917695 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:26.917830 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:26.920274 (+ 2444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:26.920278 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:26.920278 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:26.920289 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:26.922037 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:26.922435 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:26.922438 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:26.922438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:26.922534 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:26.922763 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:26.922764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:26.922764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:26.922981 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:26.923170 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:26.923248 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 18:51:26.923420 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":62,"threads_started":1}
I20260809 18:51:26.924528 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:26.925527 16812 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 42c816da91754b398b858392ed8b77bd: Generated new TSK 0
I20260809 18:51:26.925696 16812 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:26.932686 16818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:26.926014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48739 (local address 127.12.202.254:39059)
0809 18:51:26.926053 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:26.926055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:26.926162 (+ 107us) server_negotiation.cc:407] Connection header received
0809 18:51:26.926212 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:26.926212 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:26.926220 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:26.926260 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:26.926958 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:26.927436 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:26.928503 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:26.928781 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:26.928837 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:26.930150 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:26.930151 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:26.930152 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:26.930157 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:26.931566 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:26.931936 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:26.931937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:26.931937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:26.931987 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:26.932181 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:26.932182 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:26.932182 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:26.932274 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:26.932441 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:26.932570 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 18:51:26.932630 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:51:26.935338 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 16684
2026-08-09T18:51:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1536 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:27 dist-test-slave-45dx krb5kdc[16845](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:27 dist-test-slave-45dx krb5kdc[16845](info): set up 2 sockets
Aug 09 18:51:27 dist-test-slave-45dx krb5kdc[16845](info): commencing operation
krb5kdc: starting...
W20260809 18:51:28.183167 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:28 dist-test-slave-45dx krb5kdc[16845](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301488, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:51:28.313150 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:37243
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:36223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:37243
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:28.395637 16867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:28.395912 16867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:28.395957 16867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:28.397136 16867 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:28.397205 16867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:28.397229 16867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:28.397249 16867 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:28.397281 16867 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:28.398814 16867 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:36223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:37243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:37243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:28.399098 16867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:28.399319 16867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:28.404455 16880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:28.404537 16867 server_base.cc:1034] running on GCE node
W20260809 18:51:28.404448 16885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:28.404475 16882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:28.404929 16867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:28.405232 16867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:28.406409 16867 hybrid_clock.cc:648] HybridClock initialized: now 1786301488406395 us; error 43 us; skew 500 ppm
Aug 09 18:51:28 dist-test-slave-45dx krb5kdc[16845](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301488, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:28.409045 16867 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:51:28.409447 16867 webserver.cc:460] Webserver started at http://127.12.202.254:43333/ using document root <none> and password file <none>
I20260809 18:51:28.409632 16867 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:28.409672 16867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:28.409760 16867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:28.410820 16867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "2e22812edaca4dfcaa5feb46b638b086"
format_stamp: "Formatted at 2026-08-09 18:51:28 on dist-test-slave-45dx"
server_key: "b94e99d4e02ac4643367cc5403dea6a1"
server_key_iv: "76fe2475529839bfb53685c6b9201866"
server_key_version: "encryptionkey@0"
I20260809 18:51:28.411139 16867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "2e22812edaca4dfcaa5feb46b638b086"
format_stamp: "Formatted at 2026-08-09 18:51:28 on dist-test-slave-45dx"
server_key: "b94e99d4e02ac4643367cc5403dea6a1"
server_key_iv: "76fe2475529839bfb53685c6b9201866"
server_key_version: "encryptionkey@0"
I20260809 18:51:28.412487 16867 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:51:28.413184 16894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:28.413375 16867 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:51:28.413480 16867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "2e22812edaca4dfcaa5feb46b638b086"
format_stamp: "Formatted at 2026-08-09 18:51:28 on dist-test-slave-45dx"
server_key: "b94e99d4e02ac4643367cc5403dea6a1"
server_key_iv: "76fe2475529839bfb53685c6b9201866"
server_key_version: "encryptionkey@0"
I20260809 18:51:28.413539 16867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:28.431490 16867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:28.433987 16867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:28.434110 16867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:28.438300 16867 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:37243
I20260809 18:51:28.438356 16981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:37243 every 8 connection(s)
I20260809 18:51:28.438715 16867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:28.438997 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 16867
I20260809 18:51:28.439141 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:28.439390 13099 external_mini_cluster.cc:1428] Setting key 9364b3feca00ee4e194de67e29f48c8b
I20260809 18:51:28.439854 16982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:28.443248 16982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086: Bootstrap starting.
I20260809 18:51:28.443985 16982 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:28.444391 16982 log.cc:824] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:28.445264 16982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086: No bootstrap required, opened a new log
I20260809 18:51:28.445247 16987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:28.439945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39559 (local address 127.12.202.254:37243)
0809 18:51:28.440141 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:28.440150 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:28.440189 (+ 39us) server_negotiation.cc:407] Connection header received
0809 18:51:28.440692 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:28.440699 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:28.440747 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:28.440859 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:28.441123 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:28.442015 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:28.443145 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:28.443589 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:28.443668 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:28.444411 (+ 743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:28.444414 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:28.444415 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:28.444623 (+ 208us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:28.444654 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:28.444666 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:28.444720 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:28.444833 (+ 113us) server_negotiation.cc:299] Negotiation successful
0809 18:51:28.445017 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":93,"threads_started":1}
I20260809 18:51:28.446374 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:28.447671 16982 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e22812edaca4dfcaa5feb46b638b086" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 37243 } }
I20260809 18:51:28.447863 16982 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:28.447916 16982 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e22812edaca4dfcaa5feb46b638b086, State: Initialized, Role: FOLLOWER
I20260809 18:51:28.448042 16982 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e22812edaca4dfcaa5feb46b638b086" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 37243 } }
I20260809 18:51:28.448143 16982 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:28.448186 16982 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:28.448237 16982 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:28.448845 16982 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e22812edaca4dfcaa5feb46b638b086" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 37243 } }
I20260809 18:51:28.448967 16982 leader_election.cc:302] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e22812edaca4dfcaa5feb46b638b086; no voters:
I20260809 18:51:28.449133 16982 leader_election.cc:288] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:28.449203 16998 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:28.449342 16998 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086 [term 1 LEADER]: Becoming Leader. State: Replica: 2e22812edaca4dfcaa5feb46b638b086, State: Running, Role: LEADER
I20260809 18:51:28.449402 16982 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:28.449443 16998 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e22812edaca4dfcaa5feb46b638b086" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 37243 } }
I20260809 18:51:28.449774 16998 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e22812edaca4dfcaa5feb46b638b086. Latest consensus state: current_term: 1 leader_uuid: "2e22812edaca4dfcaa5feb46b638b086" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e22812edaca4dfcaa5feb46b638b086" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 37243 } } }
I20260809 18:51:28.449851 16998 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:28.450443 16999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e22812edaca4dfcaa5feb46b638b086" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e22812edaca4dfcaa5feb46b638b086" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 37243 } } }
I20260809 18:51:28.450574 16999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:28.451247 16987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:28.447787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44555 (local address 127.12.202.254:37243)
0809 18:51:28.447824 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:28.447826 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:28.447963 (+ 137us) server_negotiation.cc:407] Connection header received
0809 18:51:28.448049 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:28.448050 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:28.448061 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:28.448117 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:28.448231 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:28.448738 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:28.449730 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:28.450075 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:28.450154 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:28.450873 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:28.450874 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:28.450874 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:28.450878 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:28.450893 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:28.450897 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:28.450953 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:28.451149 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 18:51:28.451172 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 18:51:28.451275 17022 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:51:28.451314 17022 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:51:28.451610 17007 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:28.451795 17007 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:28.453271 17007 catalog_manager.cc:1347] Generated new cluster ID: 8631b8ebeb1f4616bcf774f882e9ffc3
I20260809 18:51:28.453329 17007 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:51:28.460577 17007 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:28.461104 17007 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:28.476867 17007 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e22812edaca4dfcaa5feb46b638b086: Generated new TSK 0
I20260809 18:51:28.477104 17007 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:28.486267 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 16867
2026-08-09T18:51:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1544 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:28 dist-test-slave-45dx krb5kdc[17033](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:28 dist-test-slave-45dx krb5kdc[17033](info): set up 2 sockets
Aug 09 18:51:28 dist-test-slave-45dx krb5kdc[17033](info): commencing operation
krb5kdc: starting...
W20260809 18:51:29.735324 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:29 dist-test-slave-45dx krb5kdc[17033](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:51:29.853242 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:41241
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:41111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:41241
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:29.933657 17058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:29.933903 17058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:29.933940 17058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:29.935060 17058 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:29.935129 17058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:29.935154 17058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:29.935175 17058 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:29.935205 17058 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:29.936782 17058 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:41111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:41241
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:41241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:29.937052 17058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:29.937288 17058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:29.942054 17065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:29.942147 17067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:29.942091 17069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:29.942456 17058 server_base.cc:1034] running on GCE node
I20260809 18:51:29.942735 17058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:29.943055 17058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:29.944221 17058 hybrid_clock.cc:648] HybridClock initialized: now 1786301489944208 us; error 45 us; skew 500 ppm
Aug 09 18:51:29 dist-test-slave-45dx krb5kdc[17033](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301489, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:29.946631 17058 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:51:29.947072 17058 webserver.cc:460] Webserver started at http://127.12.202.254:36967/ using document root <none> and password file <none>
I20260809 18:51:29.947317 17058 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:29.947386 17058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:29.947531 17058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:29.948616 17058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "bb3e8c021ed04065bc03ea9451c3553c"
format_stamp: "Formatted at 2026-08-09 18:51:29 on dist-test-slave-45dx"
server_key: "2219c4f661bba62efd25d0ac2a6fd5b7"
server_key_iv: "0d04360671dc720c3a1d23894e602cbc"
server_key_version: "encryptionkey@0"
I20260809 18:51:29.948972 17058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "bb3e8c021ed04065bc03ea9451c3553c"
format_stamp: "Formatted at 2026-08-09 18:51:29 on dist-test-slave-45dx"
server_key: "2219c4f661bba62efd25d0ac2a6fd5b7"
server_key_iv: "0d04360671dc720c3a1d23894e602cbc"
server_key_version: "encryptionkey@0"
I20260809 18:51:29.950223 17058 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:51:29.950888 17079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:29.951164 17058 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:51:29.951269 17058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "bb3e8c021ed04065bc03ea9451c3553c"
format_stamp: "Formatted at 2026-08-09 18:51:29 on dist-test-slave-45dx"
server_key: "2219c4f661bba62efd25d0ac2a6fd5b7"
server_key_iv: "0d04360671dc720c3a1d23894e602cbc"
server_key_version: "encryptionkey@0"
I20260809 18:51:29.951344 17058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:29.954640 17058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:29.956858 17058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:29.957011 17058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:29.960798 17058 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:41241
I20260809 18:51:29.960826 17161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:41241 every 8 connection(s)
I20260809 18:51:29.961136 17058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:29.962147 17163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:29.964289 17163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c: Bootstrap starting.
I20260809 18:51:29.964900 17163 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:29.965188 17163 log.cc:824] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:29.965844 17163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c: No bootstrap required, opened a new log
I20260809 18:51:29.967339 17163 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb3e8c021ed04065bc03ea9451c3553c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 41241 } }
I20260809 18:51:29.967473 17163 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 18:51:29.967519 17163 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb3e8c021ed04065bc03ea9451c3553c, State: Initialized, Role: FOLLOWER
I20260809 18:51:29.967696 17163 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb3e8c021ed04065bc03ea9451c3553c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 41241 } }
I20260809 18:51:29.967774 17163 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 18:51:29.967815 17163 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 18:51:29.967865 17163 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:29.968029 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 17058
I20260809 18:51:29.968147 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:29.968379 13099 external_mini_cluster.cc:1428] Setting key 0833eedc4b918c04d70ffa860045ff9d
I20260809 18:51:29.968959 17163 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb3e8c021ed04065bc03ea9451c3553c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 41241 } }
I20260809 18:51:29.969058 17163 leader_election.cc:302] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb3e8c021ed04065bc03ea9451c3553c; no voters:
I20260809 18:51:29.969228 17163 leader_election.cc:288] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 18:51:29.969276 17171 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:29.969478 17163 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:29.969476 17171 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c [term 1 LEADER]: Becoming Leader. State: Replica: bb3e8c021ed04065bc03ea9451c3553c, State: Running, Role: LEADER
I20260809 18:51:29.969971 17171 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb3e8c021ed04065bc03ea9451c3553c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 41241 } }
I20260809 18:51:29.970355 17174 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb3e8c021ed04065bc03ea9451c3553c. Latest consensus state: current_term: 1 leader_uuid: "bb3e8c021ed04065bc03ea9451c3553c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb3e8c021ed04065bc03ea9451c3553c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 41241 } } }
I20260809 18:51:29.970434 17178 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb3e8c021ed04065bc03ea9451c3553c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb3e8c021ed04065bc03ea9451c3553c" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 41241 } } }
I20260809 18:51:29.970471 17174 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:29.970492 17178 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:29.970731 17196 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:29.970783 17170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:29.968837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38559 (local address 127.12.202.254:41241)
0809 18:51:29.969005 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:29.969014 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:29.969050 (+ 36us) server_negotiation.cc:407] Connection header received
0809 18:51:29.969177 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:29.969184 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:29.969215 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:29.969360 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:29.970066 (+ 706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:29.970070 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:29.970070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:29.970075 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:29.970117 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:29.970133 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:29.970173 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:29.970307 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 18:51:29.970348 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":84,"threads_started":1}
I20260809 18:51:29.971303 17196 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:29.971725 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:29.972766 17196 catalog_manager.cc:1347] Generated new cluster ID: 6da52ca336b84b0c927ba50f01cfe1af
I20260809 18:51:29.972822 17196 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:51:29.977695 17170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:29.976587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54023 (local address 127.12.202.254:41241)
0809 18:51:29.976622 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:29.976623 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:29.976763 (+ 140us) server_negotiation.cc:407] Connection header received
0809 18:51:29.976833 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:29.976834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:29.976839 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:29.976883 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:29.977469 (+ 586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:29.977470 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:29.977470 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 18:51:29.977474 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:29.977486 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 18:51:29.977490 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:29.977534 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:29.977582 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 18:51:29.977595 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 18:51:29.993934 17196 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:29.994117 17196 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:30.000993 17196 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb3e8c021ed04065bc03ea9451c3553c: Generated new TSK 0
I20260809 18:51:30.001178 17196 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:30.006661 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 17058
2026-08-09T18:51:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1526 ms)
[----------] 18 tests from AuthTokenIssuingTest (27698 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:30 dist-test-slave-45dx krb5kdc[17217](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:30 dist-test-slave-45dx krb5kdc[17217](info): set up 2 sockets
Aug 09 18:51:30 dist-test-slave-45dx krb5kdc[17217](info): commencing operation
krb5kdc: starting...
W20260809 18:51:31.245486 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:31 dist-test-slave-45dx krb5kdc[17217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301491, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:51:31.369329 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:43563
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:46039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:43563,127.12.202.253:33905,127.12.202.252:35567
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:31.449741 17238 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 18:51:31.449944 17238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:31.449960 17238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:31.449980 17238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:31.451138 17238 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:31.451176 17238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:31.451190 17238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:31.451202 17238 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:31.451251 17238 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:31.452765 17238 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:46039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:43563,127.12.202.253:33905,127.12.202.252:35567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:43563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:31.453045 17238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:31.453271 17238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:51:31.458420 17238 server_base.cc:1034] running on GCE node
W20260809 18:51:31.458328 17247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:31.458355 17246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:31.458328 17251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:31.458824 17238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:31.459156 17238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:31.460397 17238 hybrid_clock.cc:648] HybridClock initialized: now 1786301491460374 us; error 44 us; skew 500 ppm
Aug 09 18:51:31 dist-test-slave-45dx krb5kdc[17217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301491, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:31.463002 17238 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:51:31.463383 17238 webserver.cc:460] Webserver started at http://127.12.202.254:37857/ using document root <none> and password file <none>
I20260809 18:51:31.463603 17238 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:31.463644 17238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:31.463727 17238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:31.464783 17238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "b3eae78d0b324fac83b56fb55da970b2"
format_stamp: "Formatted at 2026-08-09 18:51:31 on dist-test-slave-45dx"
server_key: "5e01d6ca7d981d0c7aa712e9045231b9"
server_key_iv: "b3a9a35a2ea704e9a616f564259c5184"
server_key_version: "encryptionkey@0"
I20260809 18:51:31.465076 17238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "b3eae78d0b324fac83b56fb55da970b2"
format_stamp: "Formatted at 2026-08-09 18:51:31 on dist-test-slave-45dx"
server_key: "5e01d6ca7d981d0c7aa712e9045231b9"
server_key_iv: "b3a9a35a2ea704e9a616f564259c5184"
server_key_version: "encryptionkey@0"
I20260809 18:51:31.466400 17238 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:51:31.467226 17262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:31.467494 17238 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 18:51:31.467603 17238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "b3eae78d0b324fac83b56fb55da970b2"
format_stamp: "Formatted at 2026-08-09 18:51:31 on dist-test-slave-45dx"
server_key: "5e01d6ca7d981d0c7aa712e9045231b9"
server_key_iv: "b3a9a35a2ea704e9a616f564259c5184"
server_key_version: "encryptionkey@0"
I20260809 18:51:31.467685 17238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:31.475984 17238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:31.477807 17238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:31.477962 17238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:31.481954 17238 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:43563
I20260809 18:51:31.482012 17345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:43563 every 8 connection(s)
I20260809 18:51:31.482345 17238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:31.483220 17346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:31.483978 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 17238
I20260809 18:51:31.484135 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:31.484377 13099 external_mini_cluster.cc:1428] Setting key 742bfce057b23726508d38c32e781b93
I20260809 18:51:31.484934 17346 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:51:31 dist-test-slave-45dx krb5kdc[17217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301491, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.202.253@KRBTEST.COM; defaulting to no policy
I20260809 18:51:31.495314 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.485586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43563 (local address 127.0.0.1:56786)
0809 18:51:31.485749 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.485788 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:31.486388 (+ 600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:31.486686 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:31.486690 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:31.487070 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:31.487302 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:31.487308 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.488281 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.488281 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:31.489046 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:31.489048 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.489553 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.489554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:31.489618 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.490177 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:31.490185 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:31.491505 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:31.493800 (+ 2295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:31.493806 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:31.493808 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:31.494065 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:31.494293 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:31.494293 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:31.494294 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:31.494382 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:31.494718 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:31.494723 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:31.494784 (+ 61us) client_negotiation.cc:769] Sending connection context
0809 18:51:31.494902 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 18:51:31.495130 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":94,"thread_start_us":87,"threads_started":1}
I20260809 18:51:31.495323 17349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.485629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56786 (local address 127.12.202.254:43563)
0809 18:51:31.485813 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.485818 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.485878 (+ 60us) server_negotiation.cc:407] Connection header received
0809 18:51:31.486547 (+ 669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.486549 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.486567 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.486650 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.487407 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.488198 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.489147 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.489458 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.489579 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.491592 (+ 2013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:31.491599 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:31.491599 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:31.491606 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:31.493704 (+ 2098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.494145 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.494147 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.494148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.494226 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.494451 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.494452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.494453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.494647 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:31.494737 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.494930 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.495066 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":81,"threads_started":1}
I20260809 18:51:31.496019 17346 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:51:31.496372 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.496234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:33905 (local address 127.0.0.1:47946)
0809 18:51:31.496283 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.496346 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.253:33905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 18:51:31.496556 17270 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.202.253:33905: connect: Connection refused (error 111)
I20260809 18:51:31.496973 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.496880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:33905 (local address 127.0.0.1:47948)
0809 18:51:31.496928 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.496953 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.253:33905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 18:51:31.497133 17346 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.253:33905: Network error: Client connection negotiation failed: client connection to 127.12.202.253:33905: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.253.keytab.
Entry for principal kudu/127.12.202.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.253.keytab.
I20260809 18:51:31.513180 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.253:33905
--webserver_interface=127.12.202.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.253.keytab
--principal=kudu/127.12.202.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:46039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:43563,127.12.202.253:33905,127.12.202.252:35567
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:51:31.546324 17346 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } attempt: 1
I20260809 18:51:31.546861 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.546724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:33905 (local address 127.0.0.1:47962)
0809 18:51:31.546793 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.546831 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.253:33905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 18:51:31.547322 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.547224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:33905 (local address 127.0.0.1:47976)
0809 18:51:31.547273 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.547300 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.253:33905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 18:51:31.547442 17346 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.253:33905: Network error: Client connection negotiation failed: client connection to 127.12.202.253:33905: connect: Connection refused (error 111)
W20260809 18:51:31.594590 17356 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 18:51:31.594842 17356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:31.594862 17356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:31.594882 17356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:31.595945 17356 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:31.595978 17356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:31.595990 17356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:31.596004 17356 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:31.596014 17356 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:31.597385 17356 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:46039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:43563,127.12.202.253:33905,127.12.202.252:35567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.253.keytab
--principal=kudu/127.12.202.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.253:33905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.202.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17356
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:31.597570 17356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:31.597725 17356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:31.602380 17369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:31.602313 17376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:31.602313 17370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:31.602780 17356 server_base.cc:1034] running on GCE node
I20260809 18:51:31.603058 17356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:31.603350 17356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:31.604478 17356 hybrid_clock.cc:648] HybridClock initialized: now 1786301491604459 us; error 37 us; skew 500 ppm
Aug 09 18:51:31 dist-test-slave-45dx krb5kdc[17217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301491, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:31.606979 17356 init.cc:377] Logged in from keytab as kudu/127.12.202.253@KRBTEST.COM (short username kudu)
I20260809 18:51:31.607336 17356 webserver.cc:460] Webserver started at http://127.12.202.253:38093/ using document root <none> and password file <none>
I20260809 18:51:31.607515 17356 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:31.607554 17356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:31.607638 17356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:31.608721 17356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-1/data/instance:
uuid: "3352f328185b491594335030b00b849e"
format_stamp: "Formatted at 2026-08-09 18:51:31 on dist-test-slave-45dx"
server_key: "ea65e708cee80c3ffc0acbc589bdb53c"
server_key_iv: "4e2bbb48c64cb149901f64073cc6cffd"
server_key_version: "encryptionkey@0"
I20260809 18:51:31.609026 17356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-1/wal/instance:
uuid: "3352f328185b491594335030b00b849e"
format_stamp: "Formatted at 2026-08-09 18:51:31 on dist-test-slave-45dx"
server_key: "ea65e708cee80c3ffc0acbc589bdb53c"
server_key_iv: "4e2bbb48c64cb149901f64073cc6cffd"
server_key_version: "encryptionkey@0"
I20260809 18:51:31.610230 17356 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:51:31.610868 17390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:31.611065 17356 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:51:31.611151 17356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-1/wal
uuid: "3352f328185b491594335030b00b849e"
format_stamp: "Formatted at 2026-08-09 18:51:31 on dist-test-slave-45dx"
server_key: "ea65e708cee80c3ffc0acbc589bdb53c"
server_key_iv: "4e2bbb48c64cb149901f64073cc6cffd"
server_key_version: "encryptionkey@0"
I20260809 18:51:31.611204 17356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:31.615592 17346 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } attempt: 2
I20260809 18:51:31.615959 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.615833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:33905 (local address 127.0.0.1:47990)
0809 18:51:31.615892 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.615931 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.253:33905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 18:51:31.616381 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.616243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:33905 (local address 127.0.0.1:47996)
0809 18:51:31.616290 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.616358 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.253:33905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 18:51:31.616500 17346 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.253:33905: Network error: Client connection negotiation failed: client connection to 127.12.202.253:33905: connect: Connection refused (error 111)
I20260809 18:51:31.628453 17356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:31.630777 17356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:31.630896 17356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:31.634812 17356 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.253:33905
I20260809 18:51:31.634845 17470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.253:33905 every 8 connection(s)
I20260809 18:51:31.635216 17356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-1/data/info.pb
I20260809 18:51:31.636114 17471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:31.637655 17471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:51:31.638671 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 17356
I20260809 18:51:31.638808 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-1/wal/instance
I20260809 18:51:31.638990 13099 external_mini_cluster.cc:1428] Setting key c04fcd22e4c22615d620e1efa3979f16
Aug 09 18:51:31 dist-test-slave-45dx krb5kdc[17217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301491, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.253@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:51:31.647307 17349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.638331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56794 (local address 127.12.202.254:43563)
0809 18:51:31.638397 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.638399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.638610 (+ 211us) server_negotiation.cc:407] Connection header received
0809 18:51:31.639207 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.639209 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.639224 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.639301 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.639874 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.640619 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.642074 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.642271 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.642326 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.644440 (+ 2114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:31.644442 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:31.644443 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:31.644450 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:31.645961 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.646357 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.646359 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.646359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.646425 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.646676 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.646677 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.646677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.646791 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:31.646867 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.647131 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.647216 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 18:51:31.647503 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.638299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43563 (local address 127.0.0.1:56794)
0809 18:51:31.638474 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.638516 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:31.639076 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:31.639366 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:31.639369 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:31.639608 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:31.639787 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:31.639790 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.640705 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.640706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:31.641985 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:31.641989 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.642344 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.642345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:31.642478 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.642979 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:31.642987 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:31.644292 (+ 1305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:31.646045 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:31.646052 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:31.646054 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:31.646280 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:31.646493 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:31.646493 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:31.646494 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:31.646605 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:31.646858 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:31.646865 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:31.647000 (+ 135us) client_negotiation.cc:769] Sending connection context
0809 18:51:31.647109 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 18:51:31.647259 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":87,"threads_started":1}
WARNING: no policy specified for kudu/127.12.202.252@KRBTEST.COM; defaulting to no policy
I20260809 18:51:31.648059 17471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.252@KRBTEST.COM" created.
Aug 09 18:51:31 dist-test-slave-45dx krb5kdc[17217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301491, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.253@KRBTEST.COM for kudu/127.12.202.253@KRBTEST.COM
I20260809 18:51:31.655781 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.648373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:33905 (local address 127.0.0.1:48006)
0809 18:51:31.648432 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.648443 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:31.648480 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:31.648714 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:31.648715 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:31.648825 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:31.648872 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:31.648873 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.649829 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.649830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:31.650304 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:31.650305 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.650830 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.650831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:31.650894 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.651234 (+ 340us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:31.651240 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:31.652661 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:31.654807 (+ 2146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:31.654808 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:31.654808 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:31.654976 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:31.655186 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:31.655187 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:31.655187 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:31.655236 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:31.655568 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:31.655569 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:31.655602 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 18:51:31.655651 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 18:51:31.655718 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 18:51:31.655925 17479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.648418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48006 (local address 127.12.202.253:33905)
0809 18:51:31.648576 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.648580 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.648598 (+ 18us) server_negotiation.cc:407] Connection header received
0809 18:51:31.648626 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.648628 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.648638 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.648700 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.649084 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.649732 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.650380 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.650736 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.650829 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.652746 (+ 1917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:31.652753 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:31.652753 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:31.652760 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:31.654715 (+ 1955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.655040 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.655044 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.655044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.655116 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.655300 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.655301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.655301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.655497 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:31.655588 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.655688 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.655788 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":130,"thread_start_us":105,"threads_started":1}
I20260809 18:51:31.656517 17471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:51:31.656898 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.656749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35567 (local address 127.0.0.1:48336)
0809 18:51:31.656803 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.656858 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:35567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 18:51:31.657049 17394 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.202.252:35567: connect: Connection refused (error 111)
I20260809 18:51:31.657509 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.657384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35567 (local address 127.0.0.1:48352)
0809 18:51:31.657445 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.657478 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:35567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 18:51:31.657680 17471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.252:35567: Network error: Client connection negotiation failed: client connection to 127.12.202.252:35567: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.252.keytab.
Entry for principal kudu/127.12.202.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.252.keytab.
I20260809 18:51:31.667078 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.252:35567
--webserver_interface=127.12.202.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.252.keytab
--principal=kudu/127.12.202.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:46039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:43563,127.12.202.253:33905,127.12.202.252:35567
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:51:31.706933 17471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } attempt: 1
I20260809 18:51:31.707472 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.707320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35567 (local address 127.0.0.1:48366)
0809 18:51:31.707389 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.707435 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:35567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 18:51:31.707638 17346 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } attempt: 3
I20260809 18:51:31.707871 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.707760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35567 (local address 127.0.0.1:48372)
0809 18:51:31.707802 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.707825 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:35567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260809 18:51:31.707953 17471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.252:35567: Network error: Client connection negotiation failed: client connection to 127.12.202.252:35567: connect: Connection refused (error 111)
Aug 09 18:51:31 dist-test-slave-45dx krb5kdc[17217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301491, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for kudu/127.12.202.253@KRBTEST.COM
I20260809 18:51:31.715339 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.707941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:33905 (local address 127.0.0.1:48010)
0809 18:51:31.708059 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.708070 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:31.708124 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:31.708277 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:31.708277 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:31.708476 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:31.708540 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:31.708542 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.709457 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.709458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:31.709991 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:31.709992 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.710512 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.710513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:31.710576 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.711063 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:31.711068 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:31.712510 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:31.714288 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:31.714289 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:31.714290 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:31.714527 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:31.714755 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:31.714756 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:31.714756 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:31.714822 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:31.715097 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:31.715098 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:31.715137 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 18:51:31.715192 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 18:51:31.715274 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96}
I20260809 18:51:31.715394 17479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.708027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48010 (local address 127.12.202.253:33905)
0809 18:51:31.708057 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.708060 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.708125 (+ 65us) server_negotiation.cc:407] Connection header received
0809 18:51:31.708194 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.708195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.708207 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.708261 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.708614 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.709374 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.710062 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.710422 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.710505 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.712591 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:31.712593 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:31.712593 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:31.712600 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:31.714186 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.714634 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.714636 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.714636 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.714693 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.714898 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.714899 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.714899 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.715030 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:31.715098 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.715230 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.715308 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260809 18:51:31.715961 17346 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:51:31.716290 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.716186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35567 (local address 127.0.0.1:48388)
0809 18:51:31.716235 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.716263 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:35567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 18:51:31.716631 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.716548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35567 (local address 127.0.0.1:48402)
0809 18:51:31.716591 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.716615 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:35567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 18:51:31.716735 17346 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.252:35567: Network error: Client connection negotiation failed: client connection to 127.12.202.252:35567: connect: Connection refused (error 111)
I20260809 18:51:31.747869 17346 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } attempt: 1
I20260809 18:51:31.748291 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.748163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35567 (local address 127.0.0.1:48416)
0809 18:51:31.748224 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.748263 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:35567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 18:51:31.748762 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.748655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35567 (local address 127.0.0.1:48422)
0809 18:51:31.748703 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.748730 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:35567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 18:51:31.748854 17346 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.252:35567: Network error: Client connection negotiation failed: client connection to 127.12.202.252:35567: connect: Connection refused (error 111)
W20260809 18:51:31.752110 17484 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 18:51:31.752354 17484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:31.752424 17484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:31.752458 17484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:31.753607 17484 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:31.753669 17484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:31.753693 17484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:31.753721 17484 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:31.753747 17484 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:31.755169 17484 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:46039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:43563,127.12.202.253:33905,127.12.202.252:35567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.252.keytab
--principal=kudu/127.12.202.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.252:35567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.202.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:31.755445 17484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:31.755661 17484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:31.760396 17495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:31.760450 17491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:31.760382 17497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:31.760692 17484 server_base.cc:1034] running on GCE node
I20260809 18:51:31.761027 17484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:31.761318 17484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:31.762476 17484 hybrid_clock.cc:648] HybridClock initialized: now 1786301491762465 us; error 40 us; skew 500 ppm
Aug 09 18:51:31 dist-test-slave-45dx krb5kdc[17217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301491, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:31.764994 17484 init.cc:377] Logged in from keytab as kudu/127.12.202.252@KRBTEST.COM (short username kudu)
I20260809 18:51:31.765417 17484 webserver.cc:460] Webserver started at http://127.12.202.252:42173/ using document root <none> and password file <none>
I20260809 18:51:31.765652 17484 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:31.765738 17484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:31.765892 17484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:31.766918 17484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-2/data/instance:
uuid: "4f506716bf87413aaa4afeb2bff4d5ac"
format_stamp: "Formatted at 2026-08-09 18:51:31 on dist-test-slave-45dx"
server_key: "2f8115c1e367db85e94f65ffe51412fe"
server_key_iv: "c3ab77bbd0e5dcfdc4203661031f5cc7"
server_key_version: "encryptionkey@0"
I20260809 18:51:31.767284 17484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-2/wal/instance:
uuid: "4f506716bf87413aaa4afeb2bff4d5ac"
format_stamp: "Formatted at 2026-08-09 18:51:31 on dist-test-slave-45dx"
server_key: "2f8115c1e367db85e94f65ffe51412fe"
server_key_iv: "c3ab77bbd0e5dcfdc4203661031f5cc7"
server_key_version: "encryptionkey@0"
I20260809 18:51:31.768611 17484 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 18:51:31.769306 17509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:31.769472 17484 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:51:31.769577 17484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-2/wal
uuid: "4f506716bf87413aaa4afeb2bff4d5ac"
format_stamp: "Formatted at 2026-08-09 18:51:31 on dist-test-slave-45dx"
server_key: "2f8115c1e367db85e94f65ffe51412fe"
server_key_iv: "c3ab77bbd0e5dcfdc4203661031f5cc7"
server_key_version: "encryptionkey@0"
I20260809 18:51:31.769649 17484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:31.776073 17471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } attempt: 2
I20260809 18:51:31.776458 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.776343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35567 (local address 127.0.0.1:48426)
0809 18:51:31.776406 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.776433 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:35567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 18:51:31.776810 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.776706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35567 (local address 127.0.0.1:48432)
0809 18:51:31.776745 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.776767 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:35567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260809 18:51:31.776889 17471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.252:35567: Network error: Client connection negotiation failed: client connection to 127.12.202.252:35567: connect: Connection refused (error 111)
I20260809 18:51:31.787195 17484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:31.789065 17484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:31.789225 17484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:31.793066 17484 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.252:35567
I20260809 18:51:31.793097 17592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.252:35567 every 8 connection(s)
I20260809 18:51:31.793428 17484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-2/data/info.pb
I20260809 18:51:31.794266 17593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:31.795766 17593 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:51:31 dist-test-slave-45dx krb5kdc[17217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301491, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.252@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:51:31.802546 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 17484
I20260809 18:51:31.802670 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786301184679835-13099-0/minicluster-data/master-2/wal/instance
I20260809 18:51:31.802862 13099 external_mini_cluster.cc:1428] Setting key 05ab3febc94df1afc3654fd5cf3e38d4
I20260809 18:51:31.804118 17349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.796417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56798 (local address 127.12.202.254:43563)
0809 18:51:31.796479 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.796481 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.796702 (+ 221us) server_negotiation.cc:407] Connection header received
0809 18:51:31.797131 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.797132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.797141 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.797193 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.797707 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.798193 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.799095 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.799271 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.799324 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.801244 (+ 1920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:31.801246 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:31.801246 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:31.801253 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:31.802764 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.803220 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.803221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.803222 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.803286 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.803542 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.803543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.803543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.803684 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:31.803758 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.803990 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.804056 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 18:51:31.804287 17595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.796404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:43563 (local address 127.0.0.1:56798)
0809 18:51:31.796581 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.796619 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:31.797056 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:31.797239 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:31.797242 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:31.797472 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:31.797641 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:31.797645 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.798270 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.798271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:31.799021 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:31.799023 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.799342 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.799342 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:31.799431 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.799864 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:31.799871 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:31.801155 (+ 1284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:31.802861 (+ 1706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:31.802869 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:31.802871 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:31.803143 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:31.803354 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:31.803355 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:31.803355 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:31.803474 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:31.803758 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:31.803763 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:31.803870 (+ 107us) client_negotiation.cc:769] Sending connection context
0809 18:51:31.803963 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 18:51:31.804075 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":83,"threads_started":1}
I20260809 18:51:31.805044 17593 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:51:31 dist-test-slave-45dx krb5kdc[17217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301491, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.252@KRBTEST.COM for kudu/127.12.202.253@KRBTEST.COM
Aug 09 18:51:31 dist-test-slave-45dx krb5kdc[17217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301491, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.252@KRBTEST.COM
I20260809 18:51:31.811872 17479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.805381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48016 (local address 127.12.202.253:33905)
0809 18:51:31.805427 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.805429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.805438 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:51:31.805487 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.805487 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.805495 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.805534 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.805793 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.806331 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.807035 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.807220 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.807299 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.809225 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:31.809227 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:31.809227 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:31.809234 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:31.810789 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.811229 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.811230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.811230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.811281 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.811470 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.811470 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.811471 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.811561 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:31.811608 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.811760 (+ 152us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.811815 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:51:31.811934 17595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.805327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:33905 (local address 127.0.0.1:48016)
0809 18:51:31.805378 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.805390 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:31.805431 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:31.805539 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:31.805539 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:31.805680 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:31.805726 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:31.805728 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.806420 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.806421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:31.806960 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:31.806961 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.807313 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.807314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:31.807377 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.807712 (+ 335us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:31.807715 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:31.809134 (+ 1419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:31.810882 (+ 1748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:31.810882 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:31.810889 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:31.811159 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:31.811347 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:31.811348 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:31.811348 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:31.811408 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:31.811623 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:31.811623 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:31.811666 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 18:51:31.811745 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 18:51:31.811829 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 18:51:31.812337 17593 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:51:31.813254 17597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.803436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48442 (local address 127.12.202.252:35567)
0809 18:51:31.803617 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.803621 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.803641 (+ 20us) server_negotiation.cc:407] Connection header received
0809 18:51:31.803659 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.803662 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.803675 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.803751 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.805069 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.806022 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.806828 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.807216 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.807286 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.810004 (+ 2718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:31.810012 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:31.810012 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:31.810019 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:31.811778 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.812500 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.812502 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.812503 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.812576 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.812783 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.812784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.812784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.812923 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:31.813058 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.813130 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.813190 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":80,"threads_started":1}
Aug 09 18:51:31 dist-test-slave-45dx krb5kdc[17217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301491, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.252@KRBTEST.COM for kudu/127.12.202.252@KRBTEST.COM
Aug 09 18:51:31 dist-test-slave-45dx krb5kdc[17217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301491, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:51:31.820122 17595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.812559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35567 (local address 127.0.0.1:48450)
0809 18:51:31.812604 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.812614 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:31.812654 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:31.812879 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:31.812880 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:31.813045 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:31.813077 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:31.813079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.813941 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.813942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:31.814822 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:31.814825 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.815210 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.815210 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:31.815255 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.815610 (+ 355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:31.815614 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:31.816802 (+ 1188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:31.819077 (+ 2275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:31.819078 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:31.819078 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:31.819284 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:31.819514 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:31.819514 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:31.819515 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:31.819568 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:31.819832 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:31.819833 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:31.819877 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 18:51:31.819957 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 18:51:31.820049 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 18:51:31.820380 17598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.812603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48450 (local address 127.12.202.252:35567)
0809 18:51:31.812752 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.812754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.812760 (+ 6us) server_negotiation.cc:407] Connection header received
0809 18:51:31.812779 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.812779 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.812788 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.812876 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.813151 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.813845 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.814902 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.815116 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.815209 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.816906 (+ 1697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:31.816908 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:31.816908 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:31.816915 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:31.818998 (+ 2083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.819364 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.819365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.819365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.819444 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.819630 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.819631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.819631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.819765 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:31.819831 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.819994 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.820130 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":129,"thread_start_us":75,"threads_started":1}
I20260809 18:51:31.821638 17593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac: Bootstrap starting.
I20260809 18:51:31.822101 17349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.814150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56812 (local address 127.12.202.254:43563)
0809 18:51:31.814211 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.814213 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.814220 (+ 7us) server_negotiation.cc:407] Connection header received
0809 18:51:31.814239 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.814240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.814249 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.814300 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.814850 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.815281 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.816202 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.816470 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.816551 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.818971 (+ 2420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:31.818973 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:31.818973 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:31.818981 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:31.820778 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.821120 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.821121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.821122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.821176 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.821384 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.821385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.821385 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.821529 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:31.821714 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.821931 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.822005 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 18:51:31.822332 17593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:31.822738 17593 log.cc:824] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:31.823545 17593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac: No bootstrap required, opened a new log
I20260809 18:51:31.823980 17346 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } attempt: 2
I20260809 18:51:31.825429 17593 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } } peers { permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } } peers { permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } }
I20260809 18:51:31.825598 17593 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f506716bf87413aaa4afeb2bff4d5ac, State: Initialized, Role: FOLLOWER
I20260809 18:51:31.825677 17593 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } } peers { permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } } peers { permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } }
I20260809 18:51:31.825947 17593 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac [sys.catalog]: configured and running, proceeding with master startup.
Aug 09 18:51:31 dist-test-slave-45dx krb5kdc[17217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301491, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.253@KRBTEST.COM
Aug 09 18:51:31 dist-test-slave-45dx krb5kdc[17217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301491, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for kudu/127.12.202.252@KRBTEST.COM
I20260809 18:51:31.827301 17605 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } } peers { permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } } peers { permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } } }
I20260809 18:51:31.828226 17605 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac [sys.catalog]: This master's current role is: FOLLOWER
W20260809 18:51:31.828504 17627 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:51:31.828554 17627 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:51:31.829130 17484 master_runner.cc:186] Error getting master registration for 127.12.202.254:43563: OK, instance_id { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" instance_seqno: 1786301491480847 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 18:51:31.831284 17484 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 18:51:31.831375 17479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.822695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48032 (local address 127.12.202.253:33905)
0809 18:51:31.822739 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.822741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.822750 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:51:31.822772 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.822773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.822782 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.822833 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.823402 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.823878 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.824783 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.825056 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.825122 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.827684 (+ 2562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:31.827686 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:31.827686 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:31.827694 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:31.829908 (+ 2214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.830278 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.830279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.830279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.830333 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.830543 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.830544 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.830544 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.830662 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:31.830839 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.831192 (+ 353us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.831264 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:51:31.831666 17598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.824262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48460 (local address 127.12.202.252:35567)
0809 18:51:31.824391 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.824400 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.824406 (+ 6us) server_negotiation.cc:407] Connection header received
0809 18:51:31.824421 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.824421 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.824428 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.824482 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.824733 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.825404 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.826324 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.826641 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.826723 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.828814 (+ 2091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:31.828815 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:31.828815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:31.828821 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:31.830446 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.830802 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.830803 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.830804 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.830858 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.831081 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.831082 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.831082 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.831218 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:31.831278 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.831530 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.831593 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260809 18:51:31.831673 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.824212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35567 (local address 127.0.0.1:48460)
0809 18:51:31.824254 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.824264 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:31.824331 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:31.824500 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:31.824501 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:31.824634 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:31.824663 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:31.824664 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.825489 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.825490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:31.826227 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:31.826230 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.826724 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.826725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:31.826781 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.827153 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:31.827158 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:31.828731 (+ 1573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:31.830525 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:31.830526 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:31.830527 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:31.830730 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:31.830960 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:31.830961 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:31.830961 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:31.831018 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:31.831397 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:31.831398 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:31.831442 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 18:51:31.831506 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 18:51:31.831590 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260809 18:51:31.833045 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:31.833735 17346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2: Bootstrap starting.
I20260809 18:51:31.834450 17346 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:31.833911 17301 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "b3eae78d0b324fac83b56fb55da970b2"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56812
I20260809 18:51:31.834760 17346 log.cc:824] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:31.835541 17346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2: No bootstrap required, opened a new log
I20260809 18:51:31.836875 17346 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } } peers { permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } } peers { permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } }
I20260809 18:51:31.837037 17346 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3eae78d0b324fac83b56fb55da970b2, State: Initialized, Role: FOLLOWER
I20260809 18:51:31.837118 17346 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } } peers { permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } } peers { permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } }
I20260809 18:51:31.837389 17630 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } } peers { permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } } peers { permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } } }
I20260809 18:51:31.837430 17346 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:31.837440 17301 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 18:51:31.837519 17630 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:51:31.837559 17301 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:31.838321 17301 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } } peers { permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } } peers { permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } }
I20260809 18:51:31.838537 17301 leader_election.cc:288] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [CANDIDATE]: Term 1 election: Requested vote from peers 3352f328185b491594335030b00b849e (127.12.202.253:33905), 4f506716bf87413aaa4afeb2bff4d5ac (127.12.202.252:35567)
I20260809 18:51:31.839032 17548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b3eae78d0b324fac83b56fb55da970b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4f506716bf87413aaa4afeb2bff4d5ac"
I20260809 18:51:31.839141 17548 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:31.839949 17548 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3eae78d0b324fac83b56fb55da970b2 in term 1.
I20260809 18:51:31.840210 17270 leader_election.cc:302] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f506716bf87413aaa4afeb2bff4d5ac, b3eae78d0b324fac83b56fb55da970b2; no voters:
I20260809 18:51:31.840410 17630 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:31.840553 17630 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [term 1 LEADER]: Becoming Leader. State: Replica: b3eae78d0b324fac83b56fb55da970b2, State: Running, Role: LEADER
I20260809 18:51:31.840654 17630 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } } peers { permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } } peers { permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } }
I20260809 18:51:31.841084 17630 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3eae78d0b324fac83b56fb55da970b2. Latest consensus state: current_term: 1 leader_uuid: "b3eae78d0b324fac83b56fb55da970b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } } peers { permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } } peers { permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } } }
I20260809 18:51:31.841162 17630 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [sys.catalog]: This master's current role is: LEADER
W20260809 18:51:31.841921 17645 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:51:31.842002 17645 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:51:31.842195 17655 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:31.842466 17655 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:31.841212 17238 master_runner.cc:186] Error getting master registration for 127.12.202.253:33905: OK, instance_id { permanent_uuid: "3352f328185b491594335030b00b849e" instance_seqno: 1786301491633728 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 18:51:31.844374 17238 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 18:51:31.845185 17548 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac [term 1 FOLLOWER]: Refusing update from remote peer b3eae78d0b324fac83b56fb55da970b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:51:31.845492 17652 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:51:31.846814 17605 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3eae78d0b324fac83b56fb55da970b2. Latest consensus state: current_term: 1 leader_uuid: "b3eae78d0b324fac83b56fb55da970b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } } peers { permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } } peers { permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } } }
I20260809 18:51:31.846909 17605 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:51:31.848086 17630 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b3eae78d0b324fac83b56fb55da970b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } } peers { permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } } peers { permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } } }
I20260809 18:51:31.848157 17630 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:31.848289 17605 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b3eae78d0b324fac83b56fb55da970b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } } peers { permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } } peers { permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } } }
I20260809 18:51:31.848384 17605 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:51:31.848587 17659 mvcc.cc:205] Tried to move back new op lower bound from 7316690910595686400 to 7316690910580047872. Current Snapshot: MvccSnapshot[applied={T|T < 7316690910595686400}]
I20260809 18:51:31.848290 17657 mvcc.cc:205] Tried to move back new op lower bound from 7316690910595686400 to 7316690910580047872. Current Snapshot: MvccSnapshot[applied={T|T < 7316690910595686400}]
I20260809 18:51:31.854050 17655 catalog_manager.cc:1347] Generated new cluster ID: 2df712a0c95e4f69be27f9171ff711c3
I20260809 18:51:31.854115 17655 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:51:31.860971 17349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.852612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56826 (local address 127.12.202.254:43563)
0809 18:51:31.852656 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.852658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.852834 (+ 176us) server_negotiation.cc:407] Connection header received
0809 18:51:31.852960 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.852961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.852971 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.853002 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.853760 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.854473 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.855553 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.855820 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.855856 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.857665 (+ 1809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:31.857666 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:31.857666 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:31.857673 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:31.859724 (+ 2051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.860121 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.860122 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.860122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.860174 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.860393 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.860394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.860394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.860514 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:31.860595 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.860809 (+ 214us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.860878 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:51:31.861920 17479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.852848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48034 (local address 127.12.202.253:33905)
0809 18:51:31.852904 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.852906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.853111 (+ 205us) server_negotiation.cc:407] Connection header received
0809 18:51:31.853264 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.853265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.853290 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.853321 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.854661 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.855312 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.856656 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.856929 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.856960 (+ 31us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.858754 (+ 1794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:31.858755 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:31.858756 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:31.858761 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:31.860187 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.860731 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.860732 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.860732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.860806 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.861242 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.861243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.861243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.861379 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:31.861445 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.861748 (+ 303us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.861825 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 18:51:31.864004 17655 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:31.864668 17655 catalog_manager.cc:1504] Loading token signing keys...
I20260809 18:51:31.868026 17471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } attempt: 3
Aug 09 18:51:31 dist-test-slave-45dx krb5kdc[17217](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301491, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.253@KRBTEST.COM for kudu/127.12.202.252@KRBTEST.COM
I20260809 18:51:31.875533 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.868234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:35567 (local address 127.0.0.1:48482)
0809 18:51:31.868330 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:31.868339 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:31.868372 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:31.868543 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:31.868544 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:31.868702 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:31.868734 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:31.868735 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.869837 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.869838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:31.870580 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:31.870582 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.871040 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.871041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:31.871090 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.871503 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:31.871508 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:31.872878 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:31.874662 (+ 1784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:31.874663 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:31.874663 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:31.874848 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:31.875010 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:31.875011 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:31.875011 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:31.875055 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:31.875271 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:31.875272 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:31.875307 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 18:51:31.875361 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 18:51:31.875447 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260809 18:51:31.875834 17597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.868338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48482 (local address 127.12.202.252:35567)
0809 18:51:31.868442 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.868444 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.868450 (+ 6us) server_negotiation.cc:407] Connection header received
0809 18:51:31.868466 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.868467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.868476 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.868513 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.868800 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.869759 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.870656 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.870952 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.870998 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.872985 (+ 1987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:31.872986 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:31.872986 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:31.872992 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:31.874584 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.874910 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.874911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.874911 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.874957 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.875110 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.875111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.875111 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.875209 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:31.875253 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.875689 (+ 436us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.875757 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 18:51:31.877487 17471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e: Bootstrap starting.
I20260809 18:51:31.878153 17471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:31.878409 17471 log.cc:824] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:31.881292 17598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.853079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48468 (local address 127.12.202.252:35567)
0809 18:51:31.853114 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.853116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.861574 (+ 8458us) server_negotiation.cc:407] Connection header received
0809 18:51:31.861660 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.861661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.861669 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.861697 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.862242 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.862949 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.876503 (+ 13554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.876809 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.876877 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.878254 (+ 1377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:31.878255 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:31.878256 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:31.878262 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:31.879734 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.880159 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.880161 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.880161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.880232 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:31.880462 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:31.880463 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:31.880464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:31.880598 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:31.880693 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.881120 (+ 427us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.881195 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 18:51:31.882630 17471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e: No bootstrap required, opened a new log
I20260809 18:51:31.886049 17471 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } } peers { permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } } peers { permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } }
I20260809 18:51:31.886322 17471 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3352f328185b491594335030b00b849e, State: Initialized, Role: FOLLOWER
I20260809 18:51:31.886512 17471 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } } peers { permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } } peers { permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } }
I20260809 18:51:31.887002 17674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } } peers { permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } } peers { permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } } }
I20260809 18:51:31.887064 17471 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:31.887074 17432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b3eae78d0b324fac83b56fb55da970b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3352f328185b491594335030b00b849e"
I20260809 18:51:31.887141 17431 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:31.888731 17431 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e [term 1 FOLLOWER]: Refusing update from remote peer b3eae78d0b324fac83b56fb55da970b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:51:31.888737 17655 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2: Generated new TSK 0
I20260809 18:51:31.889005 17655 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 18:51:31.889035 17652 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:51:31.889997 17432 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3eae78d0b324fac83b56fb55da970b2 in term 1.
I20260809 18:51:31.887141 17674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:51:31.891382 17674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b3eae78d0b324fac83b56fb55da970b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } } peers { permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } } peers { permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } } }
I20260809 18:51:31.891502 17674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:51:31.891683 17689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3eae78d0b324fac83b56fb55da970b2. Latest consensus state: current_term: 1 leader_uuid: "b3eae78d0b324fac83b56fb55da970b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } } peers { permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } } peers { permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } } }
I20260809 18:51:31.891889 17689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:51:31.892715 17702 catalog_manager.cc:1259] Loaded cluster ID: 2df712a0c95e4f69be27f9171ff711c3
I20260809 18:51:31.892760 17702 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e: loading cluster ID for follower catalog manager: success
I20260809 18:51:31.893909 17702 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e: acquiring CA information for follower catalog manager: success
I20260809 18:51:31.894254 17702 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3352f328185b491594335030b00b849e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 18:51:31.925693 17479 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:31.923919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48038 (local address 127.12.202.253:33905)
0809 18:51:31.923966 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.923969 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.924978 (+ 1009us) server_negotiation.cc:407] Connection header received
0809 18:51:31.925089 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.925090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.925102 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.925132 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.925586 (+ 454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48038: BlockingRecv error: recv got EOF from 127.0.0.1:48038 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260809 18:51:31.926652 17598 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:31.924278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48488 (local address 127.12.202.252:35567)
0809 18:51:31.924317 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.924355 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.926161 (+ 1806us) server_negotiation.cc:407] Connection header received
0809 18:51:31.926265 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.926266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.926277 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.926305 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.926594 (+ 289us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48488: BlockingRecv error: recv got EOF from 127.0.0.1:48488 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 18:51:31.927503 17349 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:31.924682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56828 (local address 127.12.202.254:43563)
0809 18:51:31.924724 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.924725 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.927028 (+ 2303us) server_negotiation.cc:407] Connection header received
0809 18:51:31.927118 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.927119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.927129 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.927156 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.927431 (+ 275us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56828: BlockingRecv error: recv got EOF from 127.0.0.1:56828 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:51:31.932296 17479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.928922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48054 (local address 127.12.202.253:33905)
0809 18:51:31.928955 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.928956 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.929120 (+ 164us) server_negotiation.cc:407] Connection header received
0809 18:51:31.929214 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.929215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.929253 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.929292 (+ 39us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:31.929490 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.930251 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.931348 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.931646 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.931687 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.931921 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:31.932043 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:31.932092 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.932210 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.932228 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
W20260809 18:51:31.935721 17598 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:31.934950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48496 (local address 127.12.202.252:35567)
0809 18:51:31.934986 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.934988 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.935203 (+ 215us) server_negotiation.cc:407] Connection header received
0809 18:51:31.935307 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.935308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.935324 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.935352 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.935670 (+ 318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48496: BlockingRecv error: recv got EOF from 127.0.0.1:48496 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 18:51:31.941375 17479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.938238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48066 (local address 127.12.202.253:33905)
0809 18:51:31.938272 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.938273 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.938496 (+ 223us) server_negotiation.cc:407] Connection header received
0809 18:51:31.938595 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.938596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.938605 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.938634 (+ 29us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:31.938811 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.939496 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.940592 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.940859 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.940919 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.941123 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:31.941154 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:31.941180 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.941285 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.941304 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 18:51:31.944622 17598 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:31.943799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48502 (local address 127.12.202.252:35567)
0809 18:51:31.943835 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.943836 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.944064 (+ 228us) server_negotiation.cc:407] Connection header received
0809 18:51:31.944160 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.944161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.944171 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.944198 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.944577 (+ 379us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48502: BlockingRecv error: recv got EOF from 127.0.0.1:48502 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 18:51:31.951045 17479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.947816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48074 (local address 127.12.202.253:33905)
0809 18:51:31.947856 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.947858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.948136 (+ 278us) server_negotiation.cc:407] Connection header received
0809 18:51:31.948235 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.948236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.948246 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.948275 (+ 29us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:31.948486 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.949166 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.950231 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.950506 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.950553 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.950759 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:31.950794 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:31.950822 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.950952 (+ 130us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.950971 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 18:51:31.955837 17598 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:31.954924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48506 (local address 127.12.202.252:35567)
0809 18:51:31.954972 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.954975 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.955261 (+ 286us) server_negotiation.cc:407] Connection header received
0809 18:51:31.955374 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.955375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.955389 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.955421 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.955778 (+ 357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48506: BlockingRecv error: recv got EOF from 127.0.0.1:48506 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:51:31.973654 17479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.970442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48088 (local address 127.12.202.253:33905)
0809 18:51:31.970487 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.970489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.970756 (+ 267us) server_negotiation.cc:407] Connection header received
0809 18:51:31.970850 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.970852 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.970863 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.970921 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:31.971062 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.971816 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.972841 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:31.973148 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:31.973217 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:31.973382 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:31.973428 (+ 46us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:31.973486 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:31.973553 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 18:51:31.973574 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260809 18:51:31.989173 17598 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:31.975456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48516 (local address 127.12.202.252:35567)
0809 18:51:31.975499 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.975501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.988476 (+ 12975us) server_negotiation.cc:407] Connection header received
0809 18:51:31.988598 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:31.988600 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:31.988614 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:31.988645 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:31.989095 (+ 450us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48516: BlockingRecv error: recv got EOF from 127.0.0.1:48516 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 18:51:32.002981 17479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:31.999664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48100 (local address 127.12.202.253:33905)
0809 18:51:31.999722 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:31.999725 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:31.999916 (+ 191us) server_negotiation.cc:407] Connection header received
0809 18:51:32.000022 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:32.000023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:32.000033 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:32.000061 (+ 28us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:32.000241 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:32.001018 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:32.002168 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:32.002445 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:32.002493 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:32.002699 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:32.002734 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:32.002763 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:32.002874 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 18:51:32.002903 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
W20260809 18:51:32.009426 17598 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:32.008617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48526 (local address 127.12.202.252:35567)
0809 18:51:32.008662 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:32.008664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:32.008875 (+ 211us) server_negotiation.cc:407] Connection header received
0809 18:51:32.008960 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:32.008961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:32.008972 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:32.009036 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:32.009341 (+ 305us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48526: BlockingRecv error: recv got EOF from 127.0.0.1:48526 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:51:32.035522 17479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:32.031973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48104 (local address 127.12.202.253:33905)
0809 18:51:32.032018 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:32.032020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:32.032297 (+ 277us) server_negotiation.cc:407] Connection header received
0809 18:51:32.032598 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:32.032599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:32.032612 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:32.032661 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:32.032840 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:32.033592 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:32.034706 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:32.035002 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:32.035046 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:32.035257 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:32.035293 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:32.035320 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:32.035423 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 18:51:32.035443 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260809 18:51:32.038935 17598 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:32.037974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48534 (local address 127.12.202.252:35567)
0809 18:51:32.038020 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:32.038022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:32.038277 (+ 255us) server_negotiation.cc:407] Connection header received
0809 18:51:32.038380 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:32.038381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:32.038394 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:32.038425 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:32.038867 (+ 442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48534: BlockingRecv error: recv got EOF from 127.0.0.1:48534 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:51:32.075201 17479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:32.072342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48108 (local address 127.12.202.253:33905)
0809 18:51:32.072395 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:32.072398 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:32.072563 (+ 165us) server_negotiation.cc:407] Connection header received
0809 18:51:32.072621 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:32.072622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:32.072631 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:32.072679 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:32.072817 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:32.073503 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:32.074597 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:32.074768 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:32.074814 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:32.074968 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:32.074993 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:32.075029 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:32.075101 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 18:51:32.075115 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
W20260809 18:51:32.077494 17598 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:32.076943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48546 (local address 127.12.202.252:35567)
0809 18:51:32.076991 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:32.076993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:32.077002 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:51:32.077071 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:32.077072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:32.077083 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:32.077124 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:32.077435 (+ 311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48546: BlockingRecv error: recv got EOF from 127.0.0.1:48546 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 18:51:32.144904 17479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:32.142672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48114 (local address 127.12.202.253:33905)
0809 18:51:32.142743 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:32.142746 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:32.142873 (+ 127us) server_negotiation.cc:407] Connection header received
0809 18:51:32.142932 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:32.142933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:32.142943 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:32.142993 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:32.143116 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:32.143576 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:32.144315 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:32.144493 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:32.144541 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:32.144656 (+ 115us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:32.144681 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:32.144718 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:32.144766 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 18:51:32.144781 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260809 18:51:32.147432 17598 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:32.146630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48550 (local address 127.12.202.252:35567)
0809 18:51:32.146699 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:32.146701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:32.146753 (+ 52us) server_negotiation.cc:407] Connection header received
0809 18:51:32.146921 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:32.146922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:32.146936 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:32.146995 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:32.147360 (+ 365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48550: BlockingRecv error: recv got EOF from 127.0.0.1:48550 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 18:51:32.278661 17479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:32.276443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59308 (local address 127.12.202.253:33905)
0809 18:51:32.276514 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:32.276518 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:32.276650 (+ 132us) server_negotiation.cc:407] Connection header received
0809 18:51:32.276716 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:32.276718 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:32.276731 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:32.276797 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:32.276918 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:32.277387 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:32.278108 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:32.278277 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:32.278325 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:32.278436 (+ 111us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:32.278461 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:32.278497 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:32.278545 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 18:51:32.278559 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260809 18:51:32.280926 17598 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:32.280231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40728 (local address 127.12.202.252:35567)
0809 18:51:32.280276 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:32.280277 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:32.280470 (+ 193us) server_negotiation.cc:407] Connection header received
0809 18:51:32.280520 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:32.280521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:32.280531 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:32.280575 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:32.280855 (+ 280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40728: BlockingRecv error: recv got EOF from 127.0.0.1:40728 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:51:32.357127 17652 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b3eae78d0b324fac83b56fb55da970b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3eae78d0b324fac83b56fb55da970b2" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 43563 } } peers { permanent_uuid: "3352f328185b491594335030b00b849e" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 33905 } } peers { permanent_uuid: "4f506716bf87413aaa4afeb2bff4d5ac" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 35567 } } }
I20260809 18:51:32.357314 17652 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3eae78d0b324fac83b56fb55da970b2 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:32.540899 17479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:32.538317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59310 (local address 127.12.202.253:33905)
0809 18:51:32.538389 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:32.538391 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:32.538484 (+ 93us) server_negotiation.cc:407] Connection header received
0809 18:51:32.538574 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:32.538575 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:32.538586 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:32.538635 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:32.538805 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:32.539340 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:32.540162 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:32.540366 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:32.540439 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:32.540618 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:32.540660 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:32.540720 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:32.540782 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 18:51:32.540802 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260809 18:51:32.543229 17598 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:32.542636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40732 (local address 127.12.202.252:35567)
0809 18:51:32.542691 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:32.542694 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:32.542703 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:51:32.542770 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:32.542771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:32.542783 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:32.542830 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:32.543170 (+ 340us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40732: BlockingRecv error: recv got EOF from 127.0.0.1:40732 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:51:32.828992 17627 catalog_manager.cc:1259] Loaded cluster ID: 2df712a0c95e4f69be27f9171ff711c3
I20260809 18:51:32.829066 17627 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac: loading cluster ID for follower catalog manager: success
I20260809 18:51:32.829895 17627 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac: acquiring CA information for follower catalog manager: success
I20260809 18:51:32.830209 17627 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4f506716bf87413aaa4afeb2bff4d5ac: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 18:51:33.058527 17887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:33.056391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59318 (local address 127.12.202.253:33905)
0809 18:51:33.056513 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:33.056515 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:33.056593 (+ 78us) server_negotiation.cc:407] Connection header received
0809 18:51:33.056669 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:33.056670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:33.056681 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:33.056730 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:33.056839 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:33.057303 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:33.057987 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:33.058167 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:33.058214 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:33.058330 (+ 116us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:33.058358 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:33.058395 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:33.058444 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 18:51:33.058460 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":70,"threads_started":1}
I20260809 18:51:33.062649 17894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:33.060377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40742 (local address 127.12.202.252:35567)
0809 18:51:33.060484 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:33.060486 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:33.060494 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:51:33.060553 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:33.060553 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:33.060603 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:33.060671 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:33.060756 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:33.061205 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:33.061874 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:33.062068 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:33.062155 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:33.062296 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:33.062408 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:33.062467 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:33.062500 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 18:51:33.062518 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":64,"threads_started":1}
I20260809 18:51:33.067322 17887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:33.064266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59326 (local address 127.12.202.253:33905)
0809 18:51:33.064331 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:33.064333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:33.064491 (+ 158us) server_negotiation.cc:407] Connection header received
0809 18:51:33.064601 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:33.064602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:33.064613 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:33.064666 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:33.064794 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:33.065478 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:33.066503 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:33.066791 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:33.066852 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:33.067038 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:33.067071 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:33.067141 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:33.067197 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 18:51:33.067222 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 18:51:33.067471 17907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:33.064281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41620 (local address 127.12.202.254:43563)
0809 18:51:33.064400 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:33.064402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:33.064543 (+ 141us) server_negotiation.cc:407] Connection header received
0809 18:51:33.064595 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:33.064596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:33.064650 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:33.064733 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:33.064958 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:33.065688 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:33.066402 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:33.066722 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:33.066788 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:33.066993 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:33.067092 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:33.067153 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:33.067352 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 18:51:33.067375 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":67,"threads_started":1}
I20260809 18:51:33.068559 17894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:33.064516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40746 (local address 127.12.202.252:35567)
0809 18:51:33.064553 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:33.064555 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:33.064657 (+ 102us) server_negotiation.cc:407] Connection header received
0809 18:51:33.064734 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:33.064735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:33.064747 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:33.064799 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:33.065715 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:33.066429 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:33.067790 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:33.068065 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:33.068130 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:33.068283 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:33.068339 (+ 56us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:33.068386 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:33.068455 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 18:51:33.068479 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:51:33.069339 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 17238
I20260809 18:51:33.092128 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 17356
I20260809 18:51:33.101572 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 17484
2026-08-09T18:51:33Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3096 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 18:51:33 dist-test-slave-45dx krb5kdc[17913](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 18:51:33 dist-test-slave-45dx krb5kdc[17913](info): set up 2 sockets
Aug 09 18:51:33 dist-test-slave-45dx krb5kdc[17913](info): commencing operation
krb5kdc: starting...
W20260809 18:51:34.364065 13099 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/test-user.keytab.
Aug 09 18:51:34 dist-test-slave-45dx krb5kdc[17913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301494, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T18:51:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T18:51:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.202.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
Entry for principal kudu/127.12.202.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab.
I20260809 18:51:34.484639 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:32785
--webserver_interface=127.12.202.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:44051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:32785,127.12.202.253:44281,127.12.202.252:40329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 18:51:34.564461 17940 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 18:51:34.564679 17940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:34.564708 17940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:34.564751 17940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:34.565862 17940 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:34.565927 17940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:34.565950 17940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:34.565969 17940 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:34.565999 17940 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:34.567397 17940 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:44051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:32785,127.12.202.253:44281,127.12.202.252:40329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.254.keytab
--principal=kudu/127.12.202.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.254:32785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.202.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:34.567690 17940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:34.567920 17940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:34.572721 17947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:34.572800 17948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:34.572818 17940 server_base.cc:1034] running on GCE node
W20260809 18:51:34.572721 17950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:34.573173 17940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:34.573470 17940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:34.574636 17940 hybrid_clock.cc:648] HybridClock initialized: now 1786301494574620 us; error 29 us; skew 500 ppm
Aug 09 18:51:34 dist-test-slave-45dx krb5kdc[17913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301494, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:34.577163 17940 init.cc:377] Logged in from keytab as kudu/127.12.202.254@KRBTEST.COM (short username kudu)
I20260809 18:51:34.577592 17940 webserver.cc:460] Webserver started at http://127.12.202.254:41347/ using document root <none> and password file <none>
I20260809 18:51:34.577828 17940 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:34.577896 17940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:34.578049 17940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:34.579046 17940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-0/data/instance:
uuid: "b897120b6c3d4e11bf97fb05da4be503"
format_stamp: "Formatted at 2026-08-09 18:51:34 on dist-test-slave-45dx"
server_key: "37567f87b124347b2290622754668025"
server_key_iv: "b1cef7c607262d721c8c5e5ddf0879b0"
server_key_version: "encryptionkey@0"
I20260809 18:51:34.579413 17940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-0/wal/instance:
uuid: "b897120b6c3d4e11bf97fb05da4be503"
format_stamp: "Formatted at 2026-08-09 18:51:34 on dist-test-slave-45dx"
server_key: "37567f87b124347b2290622754668025"
server_key_iv: "b1cef7c607262d721c8c5e5ddf0879b0"
server_key_version: "encryptionkey@0"
I20260809 18:51:34.580832 17940 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 18:51:34.581534 17962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:34.581707 17940 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 18:51:34.581840 17940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-0/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-0/wal
uuid: "b897120b6c3d4e11bf97fb05da4be503"
format_stamp: "Formatted at 2026-08-09 18:51:34 on dist-test-slave-45dx"
server_key: "37567f87b124347b2290622754668025"
server_key_iv: "b1cef7c607262d721c8c5e5ddf0879b0"
server_key_version: "encryptionkey@0"
I20260809 18:51:34.581915 17940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:34.594384 17940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:34.596843 17940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:34.597005 17940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:34.601104 17940 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.254:32785
I20260809 18:51:34.601135 18050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.254:32785 every 8 connection(s)
I20260809 18:51:34.601468 17940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-0/data/info.pb
I20260809 18:51:34.602313 18052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:34.603783 18052 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:51:34 dist-test-slave-45dx krb5kdc[17913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301494, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:51:34.610020 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 17940
I20260809 18:51:34.610143 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-0/wal/instance
I20260809 18:51:34.610378 13099 external_mini_cluster.cc:1428] Setting key 1d7c55ad9b0e1e5108ba480d7e4caa0f
I20260809 18:51:34.613179 18054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.604496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35662 (local address 127.12.202.254:32785)
0809 18:51:34.604684 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:34.604692 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:34.604824 (+ 132us) server_negotiation.cc:407] Connection header received
0809 18:51:34.605372 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:34.605374 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:34.605393 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:34.605493 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:34.606022 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.606821 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.607695 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.607998 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.608127 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.609936 (+ 1809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:34.609943 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:34.609943 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:34.609949 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:34.611530 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.611920 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.611922 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.611923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.612015 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.612254 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.612255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.612255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.612525 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:34.612615 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:34.612803 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 18:51:34.612936 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":86,"threads_started":1}
I20260809 18:51:34.613183 18056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.604485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:32785 (local address 127.0.0.1:35662)
0809 18:51:34.604675 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.604718 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:34.605201 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:34.605501 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:34.605504 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:34.605782 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:34.605922 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:34.605926 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.606937 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.606938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:34.607599 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:34.607601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.608093 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.608094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:34.608153 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.608656 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:34.608664 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:34.609856 (+ 1192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:34.611626 (+ 1770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:34.611632 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:34.611634 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:34.611828 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:34.612102 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:34.612103 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:34.612103 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:34.612186 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:34.612594 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:34.612600 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:34.612656 (+ 56us) client_negotiation.cc:769] Sending connection context
0809 18:51:34.612760 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 18:51:34.613000 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":105,"spinlock_wait_cycles":7424,"thread_start_us":89,"threads_started":1}
I20260809 18:51:34.613865 18052 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:51:34.614176 18056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.614078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:44281 (local address 127.0.0.1:55584)
0809 18:51:34.614117 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.614156 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.253:44281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260809 18:51:34.614342 17964 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.202.253:44281: connect: Connection refused (error 111)
I20260809 18:51:34.614727 18056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.614666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:44281 (local address 127.0.0.1:55588)
0809 18:51:34.614690 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.614712 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.253:44281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260809 18:51:34.614845 18052 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.253:44281: Network error: Client connection negotiation failed: client connection to 127.12.202.253:44281: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.12.202.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.253.keytab.
Entry for principal kudu/127.12.202.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.253.keytab.
I20260809 18:51:34.635622 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.253:44281
--webserver_interface=127.12.202.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.253.keytab
--principal=kudu/127.12.202.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:44051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:32785,127.12.202.253:44281,127.12.202.252:40329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:51:34.664045 18052 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } attempt: 1
I20260809 18:51:34.664553 18056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.664421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:44281 (local address 127.0.0.1:55600)
0809 18:51:34.664481 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.664521 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.253:44281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 18:51:34.664899 18056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.664800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:44281 (local address 127.0.0.1:55606)
0809 18:51:34.664846 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.664873 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.253:44281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 18:51:34.664989 18052 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.253:44281: Network error: Client connection negotiation failed: client connection to 127.12.202.253:44281: connect: Connection refused (error 111)
W20260809 18:51:34.716220 18062 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 18:51:34.716426 18062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:34.716446 18062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:34.716496 18062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:34.717628 18062 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:34.717670 18062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:34.717684 18062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:34.717696 18062 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:34.717708 18062 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:34.719044 18062 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:44051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:32785,127.12.202.253:44281,127.12.202.252:40329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.253.keytab
--principal=kudu/127.12.202.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.253:44281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.202.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:34.719221 18062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:34.719372 18062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 18:51:34.724161 18080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:34.724195 18071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:34.724182 18069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:34.724257 18062 server_base.cc:1034] running on GCE node
I20260809 18:51:34.724609 18062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:34.724920 18062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:34.726070 18062 hybrid_clock.cc:648] HybridClock initialized: now 1786301494726059 us; error 28 us; skew 500 ppm
Aug 09 18:51:34 dist-test-slave-45dx krb5kdc[17913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301494, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:34.728734 18062 init.cc:377] Logged in from keytab as kudu/127.12.202.253@KRBTEST.COM (short username kudu)
I20260809 18:51:34.729108 18062 webserver.cc:460] Webserver started at http://127.12.202.253:44349/ using document root <none> and password file <none>
I20260809 18:51:34.729334 18062 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:34.729374 18062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:34.729462 18062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:34.730448 18062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-1/data/instance:
uuid: "2485e70c95d94286a0378365ce3db945"
format_stamp: "Formatted at 2026-08-09 18:51:34 on dist-test-slave-45dx"
server_key: "9f4c4c7007e7500a58011f49e23f63dd"
server_key_iv: "e760bba910804a0171528f96355a4806"
server_key_version: "encryptionkey@0"
I20260809 18:51:34.730752 18062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-1/wal/instance:
uuid: "2485e70c95d94286a0378365ce3db945"
format_stamp: "Formatted at 2026-08-09 18:51:34 on dist-test-slave-45dx"
server_key: "9f4c4c7007e7500a58011f49e23f63dd"
server_key_iv: "e760bba910804a0171528f96355a4806"
server_key_version: "encryptionkey@0"
I20260809 18:51:34.732002 18062 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 18:51:34.732837 18088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:34.733012 18062 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:34.733108 18062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-1/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-1/wal
uuid: "2485e70c95d94286a0378365ce3db945"
format_stamp: "Formatted at 2026-08-09 18:51:34 on dist-test-slave-45dx"
server_key: "9f4c4c7007e7500a58011f49e23f63dd"
server_key_iv: "e760bba910804a0171528f96355a4806"
server_key_version: "encryptionkey@0"
I20260809 18:51:34.733192 18062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:34.733253 18052 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } attempt: 2
I20260809 18:51:34.733634 18056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.733518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:44281 (local address 127.0.0.1:55616)
0809 18:51:34.733576 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.733609 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.253:44281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 18:51:34.733959 18056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.733854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:44281 (local address 127.0.0.1:55624)
0809 18:51:34.733906 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.733931 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.253:44281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 18:51:34.734045 18052 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.253:44281: Network error: Client connection negotiation failed: client connection to 127.12.202.253:44281: connect: Connection refused (error 111)
I20260809 18:51:34.743130 18062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:34.745440 18062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:34.745602 18062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:34.749531 18062 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.253:44281
I20260809 18:51:34.749603 18170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.253:44281 every 8 connection(s)
I20260809 18:51:34.749926 18062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-1/data/info.pb
I20260809 18:51:34.750176 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 18062
I20260809 18:51:34.750290 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-1/wal/instance
I20260809 18:51:34.750595 13099 external_mini_cluster.cc:1428] Setting key b566665a2dcd7a20722b3563c81549f7
I20260809 18:51:34.751070 18172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:34.753189 18172 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:51:34 dist-test-slave-45dx krb5kdc[17913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301494, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.253@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.202.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.202.252@KRBTEST.COM" created.
I20260809 18:51:34.763002 18054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.753942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35670 (local address 127.12.202.254:32785)
0809 18:51:34.754018 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:34.754020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:34.754237 (+ 217us) server_negotiation.cc:407] Connection header received
0809 18:51:34.754686 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:34.754688 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:34.754706 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:34.754815 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:34.755527 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.756383 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.757322 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.757667 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.757755 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.760016 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:34.760018 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:34.760018 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:34.760027 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:34.761573 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.761944 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.761945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.761945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.761997 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.762239 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.762240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.762240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.762338 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:34.762388 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:34.762782 (+ 394us) server_negotiation.cc:299] Negotiation successful
0809 18:51:34.762878 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:51:34.763013 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.753920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:32785 (local address 127.0.0.1:35670)
0809 18:51:34.754101 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.754140 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:34.754588 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:34.754879 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:34.754882 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:34.755179 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:34.755354 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:34.755358 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.756476 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.756477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:34.757242 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:34.757243 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.757754 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.757755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:34.757853 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.758335 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:34.758343 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:34.759929 (+ 1586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:34.761647 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:34.761653 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:34.761655 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:34.761878 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:34.762050 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:34.762051 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:34.762052 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:34.762184 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:34.762402 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:34.762407 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:34.762582 (+ 175us) client_negotiation.cc:769] Sending connection context
0809 18:51:34.762697 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 18:51:34.762823 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":110,"threads_started":1}
I20260809 18:51:34.764712 18172 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 18:51:34 dist-test-slave-45dx krb5kdc[17913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301494, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.253@KRBTEST.COM for kudu/127.12.202.253@KRBTEST.COM
I20260809 18:51:34.772119 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.764969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:44281 (local address 127.0.0.1:55626)
0809 18:51:34.765174 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.765185 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:34.765234 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:34.765373 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:34.765374 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:34.765515 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:34.765555 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:34.765557 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.766443 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.766444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:34.766915 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:34.766917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.767402 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.767403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:34.767467 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.767927 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:34.767930 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:34.769298 (+ 1368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:34.771093 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:34.771094 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:34.771094 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:34.771330 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:34.771526 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:34.771527 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:34.771527 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:34.771595 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:34.771871 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:34.771872 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:34.771927 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 18:51:34.771995 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 18:51:34.772060 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 18:51:34.772280 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.765045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55626 (local address 127.12.202.253:44281)
0809 18:51:34.765188 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:34.765192 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:34.765234 (+ 42us) server_negotiation.cc:407] Connection header received
0809 18:51:34.765289 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:34.765292 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:34.765304 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:34.765363 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:34.765629 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.766356 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.767001 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.767309 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.767395 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.769402 (+ 2007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:34.769409 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:34.769409 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:34.769415 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:34.770918 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.771404 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.771407 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.771407 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.771461 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.771649 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.771649 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.771650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.771769 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:34.771869 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:34.772057 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 18:51:34.772121 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":88,"threads_started":1}
I20260809 18:51:34.772890 18172 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:51:34.773212 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.773110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:40329 (local address 127.0.0.1:55392)
0809 18:51:34.773153 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.773194 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:40329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260809 18:51:34.773371 18091 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.202.252:40329: connect: Connection refused (error 111)
I20260809 18:51:34.773705 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.773646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:40329 (local address 127.0.0.1:55404)
0809 18:51:34.773667 (+ 21us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.773690 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:40329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260809 18:51:34.773856 18172 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.252:40329: Network error: Client connection negotiation failed: client connection to 127.12.202.252:40329: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.202.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.252.keytab.
Entry for principal kudu/127.12.202.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.252.keytab.
I20260809 18:51:34.777375 13099 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskr0scnw/build/release/bin/kudu
/tmp/dist-test-taskr0scnw/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.252:40329
--webserver_interface=127.12.202.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.252.keytab
--principal=kudu/127.12.202.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.202.212:44051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.202.254:32785,127.12.202.253:44281,127.12.202.252:40329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 18:51:34.823088 18172 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } attempt: 1
I20260809 18:51:34.823613 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.823441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:40329 (local address 127.0.0.1:55416)
0809 18:51:34.823518 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.823572 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:40329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 18:51:34.823974 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.823875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:40329 (local address 127.0.0.1:55420)
0809 18:51:34.823925 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.823954 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:40329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 18:51:34.824097 18172 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.252:40329: Network error: Client connection negotiation failed: client connection to 127.12.202.252:40329: connect: Connection refused (error 111)
I20260809 18:51:34.825173 18052 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } attempt: 3
Aug 09 18:51:34 dist-test-slave-45dx krb5kdc[17913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301494, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for kudu/127.12.202.253@KRBTEST.COM
I20260809 18:51:34.832499 18056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.825449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:44281 (local address 127.0.0.1:55636)
0809 18:51:34.825503 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.825516 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:34.825584 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:34.825723 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:34.825724 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:34.825900 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:34.825971 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:34.825973 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.826636 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.826637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:34.827190 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:34.827192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.827610 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.827611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:34.827702 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.828228 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:34.828232 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:34.829726 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:34.831485 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:34.831486 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:34.831486 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:34.831646 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:34.831846 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:34.831846 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:34.831847 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:34.831897 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:34.832197 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:34.832197 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:34.832237 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 18:51:34.832287 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 18:51:34.832431 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 18:51:34.832525 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.825517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55636 (local address 127.12.202.253:44281)
0809 18:51:34.825578 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:34.825580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:34.825592 (+ 12us) server_negotiation.cc:407] Connection header received
0809 18:51:34.825652 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:34.825653 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:34.825664 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:34.825720 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:34.826063 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.826552 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.827275 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.827533 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.827610 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.829819 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:34.829821 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:34.829821 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:34.829829 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:34.831392 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.831711 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.831712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.831712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.831774 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.831956 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.831957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.831958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.832120 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:34.832201 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:34.832352 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 18:51:34.832434 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 18:51:34.833043 18052 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:51:34.833389 18056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.833284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:40329 (local address 127.0.0.1:55426)
0809 18:51:34.833333 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.833360 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:40329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 18:51:34.833766 18056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.833679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:40329 (local address 127.0.0.1:55436)
0809 18:51:34.833727 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.833752 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:40329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 18:51:34.833873 18052 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.252:40329: Network error: Client connection negotiation failed: client connection to 127.12.202.252:40329: connect: Connection refused (error 111)
W20260809 18:51:34.861362 18182 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 18:51:34.861581 18182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 18:51:34.861598 18182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 18:51:34.861617 18182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 18:51:34.862800 18182 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 18:51:34.862841 18182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 18:51:34.862855 18182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 18:51:34.862867 18182 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 18:51:34.862908 18182 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 18:51:34.864468 18182 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.202.212:44051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.202.254:32785,127.12.202.253:44281,127.12.202.252:40329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/krb5kdc/kudu_127.12.202.252.keytab
--principal=kudu/127.12.202.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.202.252:40329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.202.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 17:56:31 UTC on ccycloud.quasar-esvprx.root.comops.site
build id 4576688
I20260809 18:51:34.864728 18182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 18:51:34.864974 18182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 18:51:34.865023 18052 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } attempt: 1
I20260809 18:51:34.865489 18056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.865341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:40329 (local address 127.0.0.1:55442)
0809 18:51:34.865405 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.865447 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:40329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 18:51:34.865897 18056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.865814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:40329 (local address 127.0.0.1:55452)
0809 18:51:34.865855 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.865881 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:40329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260809 18:51:34.866004 18052 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.252:40329: Network error: Client connection negotiation failed: client connection to 127.12.202.252:40329: connect: Connection refused (error 111)
W20260809 18:51:34.870076 18194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:34.870038 18197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 18:51:34.870095 18192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 18:51:34.870297 18182 server_base.cc:1034] running on GCE node
I20260809 18:51:34.870606 18182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 18:51:34.870925 18182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 18:51:34.872090 18182 hybrid_clock.cc:648] HybridClock initialized: now 1786301494872075 us; error 44 us; skew 500 ppm
Aug 09 18:51:34 dist-test-slave-45dx krb5kdc[17913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301494, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 18:51:34.874527 18182 init.cc:377] Logged in from keytab as kudu/127.12.202.252@KRBTEST.COM (short username kudu)
I20260809 18:51:34.874958 18182 webserver.cc:460] Webserver started at http://127.12.202.252:35275/ using document root <none> and password file <none>
I20260809 18:51:34.875195 18182 fs_manager.cc:359] Metadata directory not provided
I20260809 18:51:34.875262 18182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 18:51:34.875434 18182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 18:51:34.876530 18182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-2/data/instance:
uuid: "465be9c9ddaa49998955dfc873a3c6e5"
format_stamp: "Formatted at 2026-08-09 18:51:34 on dist-test-slave-45dx"
server_key: "d667c4875f20d46fdde3f7f055d8116f"
server_key_iv: "d9d43b125310f77de3dc5a9fe63b4df2"
server_key_version: "encryptionkey@0"
I20260809 18:51:34.876891 18182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-2/wal/instance:
uuid: "465be9c9ddaa49998955dfc873a3c6e5"
format_stamp: "Formatted at 2026-08-09 18:51:34 on dist-test-slave-45dx"
server_key: "d667c4875f20d46fdde3f7f055d8116f"
server_key_iv: "d9d43b125310f77de3dc5a9fe63b4df2"
server_key_version: "encryptionkey@0"
I20260809 18:51:34.878202 18182 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 18:51:34.878895 18208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 18:51:34.879065 18182 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 18:51:34.879168 18182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-2/data,/tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-2/wal
uuid: "465be9c9ddaa49998955dfc873a3c6e5"
format_stamp: "Formatted at 2026-08-09 18:51:34 on dist-test-slave-45dx"
server_key: "d667c4875f20d46fdde3f7f055d8116f"
server_key_iv: "d9d43b125310f77de3dc5a9fe63b4df2"
server_key_version: "encryptionkey@0"
I20260809 18:51:34.879240 18182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 18:51:34.891837 18182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 18:51:34.892277 18172 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } attempt: 2
I20260809 18:51:34.892692 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.892557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:40329 (local address 127.0.0.1:55466)
0809 18:51:34.892621 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.892660 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:40329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 18:51:34.893127 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.893011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:40329 (local address 127.0.0.1:55474)
0809 18:51:34.893064 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.893097 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.202.252:40329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 18:51:34.893231 18172 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.202.252:40329: Network error: Client connection negotiation failed: client connection to 127.12.202.252:40329: connect: Connection refused (error 111)
I20260809 18:51:34.894167 18182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 18:51:34.894326 18182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 18:51:34.898269 18182 rpc_server.cc:307] RPC server started. Bound to: 127.12.202.252:40329
I20260809 18:51:34.898319 18300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.202.252:40329 every 8 connection(s)
I20260809 18:51:34.898674 18182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-2/data/info.pb
I20260809 18:51:34.899565 18301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 18:51:34.901079 18301 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:51:34.902311 13099 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskr0scnw/build/release/bin/kudu as pid 18182
I20260809 18:51:34.902446 13099 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskr0scnw/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786301184679835-13099-0/minicluster-data/master-2/wal/instance
I20260809 18:51:34.902659 13099 external_mini_cluster.cc:1428] Setting key fc4deead750afe45f7c9ddda7ff23b45
Aug 09 18:51:34 dist-test-slave-45dx krb5kdc[17913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301494, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.252@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
Aug 09 18:51:34 dist-test-slave-45dx krb5kdc[17913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301494, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.252@KRBTEST.COM
I20260809 18:51:34.910377 18054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.901674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35684 (local address 127.12.202.254:32785)
0809 18:51:34.901802 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:34.901804 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:34.901887 (+ 83us) server_negotiation.cc:407] Connection header received
0809 18:51:34.902491 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:34.902492 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:34.902506 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:34.902570 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:34.903317 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.903788 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.904765 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.904962 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.905035 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.907336 (+ 2301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:34.907337 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:34.907337 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:34.907343 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:34.908898 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.909382 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.909383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.909384 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.909434 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.909697 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.909697 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.909698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.909807 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:34.909859 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:34.910182 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 18:51:34.910262 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 18:51:34.910418 18304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.901616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.254:32785 (local address 127.0.0.1:35684)
0809 18:51:34.901774 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.901813 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:34.902347 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:34.902647 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:34.902650 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:34.902941 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:34.903221 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:34.903226 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.903882 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.903883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:34.904676 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:34.904679 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.905053 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.905054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:34.905165 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.905630 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:34.905637 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:34.907254 (+ 1617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:34.908997 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:34.909003 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:34.909004 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:34.909307 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:34.909511 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:34.909512 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:34.909513 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:34.909627 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:34.909874 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:34.909880 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:34.910036 (+ 156us) client_negotiation.cc:769] Sending connection context
0809 18:51:34.910134 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 18:51:34.910234 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":58,"threads_started":1}
I20260809 18:51:34.910970 18301 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:51:34.911279 18306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.903029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55476 (local address 127.12.202.252:40329)
0809 18:51:34.903218 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:34.903222 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:34.903250 (+ 28us) server_negotiation.cc:407] Connection header received
0809 18:51:34.903304 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:34.903307 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:34.903326 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:34.903391 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:34.903968 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.904805 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.905557 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.905858 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.905936 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.908187 (+ 2251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:34.908195 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:34.908195 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:34.908201 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:34.909976 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.910366 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.910369 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.910369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.910488 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.910719 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.910720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.910720 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.910895 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:34.911060 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:34.911116 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 18:51:34.911189 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":75,"threads_started":1}
Aug 09 18:51:34 dist-test-slave-45dx krb5kdc[17913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301494, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.252@KRBTEST.COM for kudu/127.12.202.253@KRBTEST.COM
Aug 09 18:51:34 dist-test-slave-45dx krb5kdc[17913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301494, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.254@KRBTEST.COM
I20260809 18:51:34.917930 18304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.911200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.253:44281 (local address 127.0.0.1:55650)
0809 18:51:34.911239 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.911248 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:34.911281 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:34.911428 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:34.911429 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:34.911561 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:34.911606 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:34.911608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.912507 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.912508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:34.913061 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:34.913063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.913498 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.913498 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:34.913567 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.913920 (+ 353us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:34.913925 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:34.915221 (+ 1296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:34.916980 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:34.916981 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:34.916982 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:34.917186 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:34.917384 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:34.917384 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:34.917385 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:34.917437 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:34.917667 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:34.917668 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:34.917705 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 18:51:34.917767 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 18:51:34.917849 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260809 18:51:34.917933 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.911254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55650 (local address 127.12.202.253:44281)
0809 18:51:34.911309 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:34.911311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:34.911318 (+ 7us) server_negotiation.cc:407] Connection header received
0809 18:51:34.911343 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:34.911344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:34.911352 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:34.911412 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:34.911684 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.912436 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.913157 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.913427 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.913476 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.915320 (+ 1844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:34.915321 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:34.915321 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:34.915329 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:34.916889 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.917264 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.917265 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.917266 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.917315 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.917503 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.917504 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.917504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.917605 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:34.917673 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:34.917798 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 18:51:34.917859 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 18:51:34.918511 18301 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } has no permanent_uuid. Determining permanent_uuid...
I20260809 18:51:34.918829 18054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.912055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35688 (local address 127.12.202.254:32785)
0809 18:51:34.912095 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:34.912096 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:34.912105 (+ 9us) server_negotiation.cc:407] Connection header received
0809 18:51:34.912149 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:34.912150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:34.912158 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:34.912213 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:34.912737 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.913188 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.914030 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.914197 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.914247 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.916381 (+ 2134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:34.916382 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:34.916382 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:34.916394 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:34.917740 (+ 1346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.918082 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.918083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.918084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.918137 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.918322 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.918323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.918323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.918422 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:34.918617 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:34.918652 (+ 35us) server_negotiation.cc:299] Negotiation successful
0809 18:51:34.918719 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 09 18:51:34 dist-test-slave-45dx krb5kdc[17913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301494, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.252@KRBTEST.COM for kudu/127.12.202.252@KRBTEST.COM
Aug 09 18:51:34 dist-test-slave-45dx krb5kdc[17913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301494, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.202.253@KRBTEST.COM
I20260809 18:51:34.925757 18306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.918788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55480 (local address 127.12.202.252:40329)
0809 18:51:34.918817 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:34.918818 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:34.918825 (+ 7us) server_negotiation.cc:407] Connection header received
0809 18:51:34.919108 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:34.919109 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:34.919119 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:34.919167 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:34.919512 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.920208 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.921018 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.921312 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.921378 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.922979 (+ 1601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:34.922981 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:34.922981 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:34.922988 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:34.924570 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.924975 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.924976 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.924976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.925043 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.925259 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.925260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.925260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.925375 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:34.925424 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:34.925582 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 18:51:34.925693 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":16}
I20260809 18:51:34.925784 18304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.918756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:40329 (local address 127.0.0.1:55480)
0809 18:51:34.918790 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.918799 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:34.918837 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:34.919214 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:34.919214 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:34.919401 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:34.919434 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:34.919436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.920277 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.920278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:34.920944 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:34.920946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.921382 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.921383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:34.921423 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.921764 (+ 341us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:34.921768 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:34.922899 (+ 1131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:34.924662 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:34.924662 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:34.924663 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:34.924900 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:34.925111 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:34.925112 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:34.925112 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:34.925190 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:34.925439 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:34.925440 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:34.925487 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 18:51:34.925566 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 18:51:34.925652 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260809 18:51:34.927201 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.919467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55666 (local address 127.12.202.253:44281)
0809 18:51:34.919521 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:34.919522 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:34.919530 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:51:34.919548 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:34.919548 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:34.919556 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:34.919609 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:34.920128 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.920752 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.921546 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.921827 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.921909 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.924240 (+ 2331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:34.924241 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:34.924241 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:34.924247 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:34.926245 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.926587 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.926587 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.926588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.926633 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.926807 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.926807 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.926807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.926893 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:34.927020 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:34.927095 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 18:51:34.927146 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 18:51:34.927379 18301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5: Bootstrap starting.
I20260809 18:51:34.928499 18301 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:34.928818 18301 log.cc:824] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:34.929277 13099 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 18:51:34.929584 18301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5: No bootstrap required, opened a new log
I20260809 18:51:34.930253 18005 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "b897120b6c3d4e11bf97fb05da4be503"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35688
I20260809 18:51:34.930959 18301 raft_consensus.cc:348] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } } peers { permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } } peers { permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } }
I20260809 18:51:34.931110 18301 raft_consensus.cc:729] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 465be9c9ddaa49998955dfc873a3c6e5, State: Initialized, Role: FOLLOWER
I20260809 18:51:34.931195 18301 consensus_queue.cc:260] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } } peers { permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } } peers { permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } }
I20260809 18:51:34.931499 18301 sys_catalog.cc:564] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:34.931533 18308 sys_catalog.cc:455] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } } peers { permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } } peers { permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } } }
I20260809 18:51:34.931635 18308 sys_catalog.cc:458] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 18:51:34.933336 18333 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:51:34.933425 18333 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:51:34.933651 18182 master_runner.cc:186] Error getting master registration for 127.12.202.254:32785: OK, instance_id { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" instance_seqno: 1786301494599841 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 18:51:34.935873 18182 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 18:51:34.941143 18052 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } attempt: 2
Aug 09 18:51:34 dist-test-slave-45dx krb5kdc[17913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301494, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.254@KRBTEST.COM for kudu/127.12.202.252@KRBTEST.COM
I20260809 18:51:34.948320 18056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.941396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:40329 (local address 127.0.0.1:55486)
0809 18:51:34.941460 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.941471 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:34.941513 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:34.941626 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:34.941627 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:34.941816 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:34.941853 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:34.941854 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.942508 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.942509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:34.943017 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:34.943018 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.943372 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.943373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:34.943429 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.943907 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:34.943912 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:34.945278 (+ 1366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:34.947167 (+ 1889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:34.947169 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:34.947169 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:34.947395 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:34.947614 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:34.947615 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:34.947616 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:34.947684 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:34.947982 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:34.947983 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:34.948031 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 18:51:34.948104 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 18:51:34.948198 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 18:51:34.948330 18306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.941468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55486 (local address 127.12.202.252:40329)
0809 18:51:34.941528 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:34.941530 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:34.941538 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:51:34.941569 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:34.941570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:34.941579 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:34.941623 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:34.941938 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.942417 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.943109 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.943296 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.943374 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.945373 (+ 1999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:34.945374 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:34.945374 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:34.945381 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:34.947081 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.947481 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.947482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.947482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.947541 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.947750 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.947751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.947751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.947911 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:34.947977 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:34.948140 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 18:51:34.948219 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 18:51:34.949890 18052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503: Bootstrap starting.
I20260809 18:51:34.950632 18052 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:34.950941 18052 log.cc:824] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:34.951754 18052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503: No bootstrap required, opened a new log
I20260809 18:51:34.952862 18052 raft_consensus.cc:348] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } } peers { permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } } peers { permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } }
I20260809 18:51:34.953001 18052 raft_consensus.cc:729] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b897120b6c3d4e11bf97fb05da4be503, State: Initialized, Role: FOLLOWER
I20260809 18:51:34.953100 18052 consensus_queue.cc:260] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } } peers { permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } } peers { permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } }
I20260809 18:51:34.953357 18337 sys_catalog.cc:455] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } } peers { permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } } peers { permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } } }
I20260809 18:51:34.953419 18052 sys_catalog.cc:564] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:34.953441 18337 sys_catalog.cc:458] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:51:34.953627 18005 raft_consensus.cc:482] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 18:51:34.953729 18005 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:34.954536 18005 raft_consensus.cc:504] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } } peers { permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } } peers { permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } }
I20260809 18:51:34.955186 18005 leader_election.cc:288] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [CANDIDATE]: Term 1 election: Requested vote from peers 2485e70c95d94286a0378365ce3db945 (127.12.202.253:44281), 465be9c9ddaa49998955dfc873a3c6e5 (127.12.202.252:40329)
W20260809 18:51:34.955281 18350 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:51:34.955372 18350 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:51:34.955439 18252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b897120b6c3d4e11bf97fb05da4be503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "465be9c9ddaa49998955dfc873a3c6e5"
I20260809 18:51:34.955547 18252 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:34.956513 18252 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b897120b6c3d4e11bf97fb05da4be503 in term 1.
I20260809 18:51:34.956748 17966 leader_election.cc:302] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 465be9c9ddaa49998955dfc873a3c6e5, b897120b6c3d4e11bf97fb05da4be503; no voters:
I20260809 18:51:34.956873 18337 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 18:51:34.957001 18337 raft_consensus.cc:686] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [term 1 LEADER]: Becoming Leader. State: Replica: b897120b6c3d4e11bf97fb05da4be503, State: Running, Role: LEADER
I20260809 18:51:34.957080 18337 consensus_queue.cc:237] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } } peers { permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } } peers { permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } }
I20260809 18:51:34.957535 18337 sys_catalog.cc:455] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b897120b6c3d4e11bf97fb05da4be503. Latest consensus state: current_term: 1 leader_uuid: "b897120b6c3d4e11bf97fb05da4be503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } } peers { permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } } peers { permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } } }
I20260809 18:51:34.957602 18337 sys_catalog.cc:458] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:34.960490 18361 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 18:51:34.960893 18361 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 18:51:34.958598 17940 master_runner.cc:186] Error getting master registration for 127.12.202.253:44281: OK, instance_id { permanent_uuid: "2485e70c95d94286a0378365ce3db945" instance_seqno: 1786301494748383 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 18:51:34.961074 17940 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 18:51:34.962529 18252 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5 [term 1 FOLLOWER]: Refusing update from remote peer b897120b6c3d4e11bf97fb05da4be503: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:51:34.962896 18359 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:51:34.964143 18308 sys_catalog.cc:455] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b897120b6c3d4e11bf97fb05da4be503. Latest consensus state: current_term: 1 leader_uuid: "b897120b6c3d4e11bf97fb05da4be503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } } peers { permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } } peers { permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } } }
I20260809 18:51:34.964241 18308 sys_catalog.cc:458] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:51:34.978960 18359 sys_catalog.cc:455] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b897120b6c3d4e11bf97fb05da4be503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } } peers { permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } } peers { permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } } }
I20260809 18:51:34.979125 18359 sys_catalog.cc:458] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:34.979133 18308 sys_catalog.cc:455] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b897120b6c3d4e11bf97fb05da4be503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } } peers { permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } } peers { permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } } }
I20260809 18:51:34.979228 18308 sys_catalog.cc:458] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:51:34.979385 18367 mvcc.cc:205] Tried to move back new op lower bound from 7316690923364003840 to 7316690923344891904. Current Snapshot: MvccSnapshot[applied={T|T < 7316690923364003840}]
I20260809 18:51:34.979446 18368 mvcc.cc:205] Tried to move back new op lower bound from 7316690923364003840 to 7316690923344891904. Current Snapshot: MvccSnapshot[applied={T|T < 7316690923364003840}]
I20260809 18:51:34.980858 18054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.960824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35694 (local address 127.12.202.254:32785)
0809 18:51:34.960868 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:34.960870 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:34.961505 (+ 635us) server_negotiation.cc:407] Connection header received
0809 18:51:34.961727 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:34.961729 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:34.961754 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:34.961786 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:34.963157 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.963792 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.965159 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.965461 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.965505 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.967136 (+ 1631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:34.967138 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:34.967138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:34.967146 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:34.968794 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.979751 (+ 10957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.979753 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.979753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.979831 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.980123 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.980124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.980124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.980275 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:34.980380 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:34.980701 (+ 321us) server_negotiation.cc:299] Negotiation successful
0809 18:51:34.980782 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 18:51:34.982105 18306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.961154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55494 (local address 127.12.202.252:40329)
0809 18:51:34.961193 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:34.961195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:34.968861 (+ 7666us) server_negotiation.cc:407] Connection header received
0809 18:51:34.968883 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:34.968884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:34.968895 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:34.968942 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:34.970155 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.970831 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.973589 (+ 2758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.973886 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.973928 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.976507 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:34.976508 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:34.976508 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:34.976515 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:34.978254 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.980339 (+ 2085us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.980340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.980341 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.980408 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.980990 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.980991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.980991 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.981120 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:34.981203 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:34.981938 (+ 735us) server_negotiation.cc:299] Negotiation successful
0809 18:51:34.982020 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 18:51:34.982733 18361 catalog_manager.cc:1347] Generated new cluster ID: bfbce3cac0264f2f873ed54974e4d017
I20260809 18:51:34.982785 18361 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 18:51:34.982978 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.961464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55670 (local address 127.12.202.253:44281)
0809 18:51:34.961557 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:34.961560 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:34.968974 (+ 7414us) server_negotiation.cc:407] Connection header received
0809 18:51:34.969000 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:34.969001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:34.969011 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:34.969058 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:34.971850 (+ 2792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.972586 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.974242 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.974566 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.974604 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.976804 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:34.976805 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:34.976805 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:34.976813 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:34.978531 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.980576 (+ 2045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.980577 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.980578 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.980637 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.981471 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.981472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.981472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.981605 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:34.981692 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:34.982808 (+ 1116us) server_negotiation.cc:299] Negotiation successful
0809 18:51:34.982889 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 18:51:34.984354 18172 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } attempt: 3
Aug 09 18:51:34 dist-test-slave-45dx krb5kdc[17913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786301494, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.202.253@KRBTEST.COM for kudu/127.12.202.252@KRBTEST.COM
I20260809 18:51:34.992895 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.984589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.202.252:40329 (local address 127.0.0.1:55508)
0809 18:51:34.984671 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0809 18:51:34.984680 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 18:51:34.984712 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 18:51:34.984921 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 18:51:34.984922 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 18:51:34.985064 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0809 18:51:34.985100 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:34.985102 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.985976 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.985977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:34.986719 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 18:51:34.986721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.988008 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.988009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 18:51:34.988071 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.988568 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 18:51:34.988573 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 18:51:34.990038 (+ 1465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 18:51:34.991833 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:34.991834 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:34.991834 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:34.992041 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:34.992234 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 18:51:34.992234 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 18:51:34.992235 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 18:51:34.992287 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 18:51:34.992607 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 18:51:34.992608 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 18:51:34.992649 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 18:51:34.992712 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 18:51:34.992803 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 18:51:34.993278 18306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:34.984786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55508 (local address 127.12.202.252:40329)
0809 18:51:34.984816 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:34.984817 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:34.984823 (+ 6us) server_negotiation.cc:407] Connection header received
0809 18:51:34.984839 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:34.984840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:34.984847 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:34.984888 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:34.985168 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.985847 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.986808 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:34.987103 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:34.987168 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:34.990127 (+ 2959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 18:51:34.990129 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 18:51:34.990129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 18:51:34.990135 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 18:51:34.991739 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.992117 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.992118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.992118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.992171 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 18:51:34.992403 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 18:51:34.992404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 18:51:34.992404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 18:51:34.992524 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 18:51:34.992581 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:34.993115 (+ 534us) server_negotiation.cc:299] Negotiation successful
0809 18:51:34.993189 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 18:51:34.994798 18172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945: Bootstrap starting.
I20260809 18:51:34.995553 18172 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945: Neither blocks nor log segments found. Creating new log.
I20260809 18:51:34.995864 18172 log.cc:824] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945: Log is configured to *not* fsync() on all Append() calls
I20260809 18:51:35.013101 18172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945: No bootstrap required, opened a new log
I20260809 18:51:35.015363 18172 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } } peers { permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } } peers { permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } }
I20260809 18:51:35.015522 18172 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2485e70c95d94286a0378365ce3db945, State: Initialized, Role: FOLLOWER
I20260809 18:51:35.015609 18172 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } } peers { permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } } peers { permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } }
I20260809 18:51:35.016942 18131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b897120b6c3d4e11bf97fb05da4be503" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2485e70c95d94286a0378365ce3db945"
I20260809 18:51:35.017002 18130 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945 [term 0 FOLLOWER]: Advancing to term 1
I20260809 18:51:35.018086 18130 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945 [term 1 FOLLOWER]: Refusing update from remote peer b897120b6c3d4e11bf97fb05da4be503: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 18:51:35.018414 18359 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 18:51:35.019325 18131 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b897120b6c3d4e11bf97fb05da4be503 in term 1.
I20260809 18:51:35.016888 18172 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 18:51:35.021270 18361 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 18:51:35.022259 18361 catalog_manager.cc:1504] Loading token signing keys...
W20260809 18:51:35.022902 18402 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 18:51:35.022960 18402 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 18:51:35.023211 18383 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b897120b6c3d4e11bf97fb05da4be503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } } peers { permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } } peers { permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } } }
I20260809 18:51:35.023299 18383 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:51:35.024469 18383 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b897120b6c3d4e11bf97fb05da4be503. Latest consensus state: current_term: 1 leader_uuid: "b897120b6c3d4e11bf97fb05da4be503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } } peers { permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } } peers { permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } } }
I20260809 18:51:35.024549 18383 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:51:35.024580 18383 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b897120b6c3d4e11bf97fb05da4be503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } } peers { permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } } peers { permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } } }
I20260809 18:51:35.024627 18383 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 18:51:35.026065 18337 sys_catalog.cc:455] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b897120b6c3d4e11bf97fb05da4be503" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897120b6c3d4e11bf97fb05da4be503" member_type: VOTER last_known_addr { host: "127.12.202.254" port: 32785 } } peers { permanent_uuid: "2485e70c95d94286a0378365ce3db945" member_type: VOTER last_known_addr { host: "127.12.202.253" port: 44281 } } peers { permanent_uuid: "465be9c9ddaa49998955dfc873a3c6e5" member_type: VOTER last_known_addr { host: "127.12.202.252" port: 40329 } } }
I20260809 18:51:35.026149 18337 sys_catalog.cc:458] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503 [sys.catalog]: This master's current role is: LEADER
I20260809 18:51:35.026379 18380 mvcc.cc:205] Tried to move back new op lower bound from 7316690923364003840 to 7316690923344891904. Current Snapshot: MvccSnapshot[applied={T|T < 7316690923364003840}]
I20260809 18:51:35.029181 18361 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b897120b6c3d4e11bf97fb05da4be503: Generated new TSK 0
I20260809 18:51:35.029366 18361 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 18:51:35.061622 18306 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:35.059958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55516 (local address 127.12.202.252:40329)
0809 18:51:35.060002 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:35.060004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:35.060960 (+ 956us) server_negotiation.cc:407] Connection header received
0809 18:51:35.061063 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:35.061065 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:35.061077 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:35.061106 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:35.061555 (+ 449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55516: BlockingRecv error: recv got EOF from 127.0.0.1:55516 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 18:51:35.062377 18054 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:35.060358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35704 (local address 127.12.202.254:32785)
0809 18:51:35.060405 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:35.060407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:35.061892 (+ 1485us) server_negotiation.cc:407] Connection header received
0809 18:51:35.061990 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:35.061991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:35.062001 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:35.062030 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:35.062320 (+ 290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35704: BlockingRecv error: recv got EOF from 127.0.0.1:35704 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 18:51:35.063237 18179 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:35.060665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55680 (local address 127.12.202.253:44281)
0809 18:51:35.060702 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:35.060704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:35.062587 (+ 1883us) server_negotiation.cc:407] Connection header received
0809 18:51:35.062741 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:35.062742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:35.062753 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:35.062782 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:35.063178 (+ 396us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55680: BlockingRecv error: recv got EOF from 127.0.0.1:55680 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 18:51:35.065629 18179 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:35.064817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55694 (local address 127.12.202.253:44281)
0809 18:51:35.064851 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:35.064853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:35.065094 (+ 241us) server_negotiation.cc:407] Connection header received
0809 18:51:35.065202 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:35.065204 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:35.065221 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:35.065253 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:35.065586 (+ 333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55694: BlockingRecv error: recv got EOF from 127.0.0.1:55694 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260809 18:51:35.068948 18179 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:35.068076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55700 (local address 127.12.202.253:44281)
0809 18:51:35.068109 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:35.068111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:35.068439 (+ 328us) server_negotiation.cc:407] Connection header received
0809 18:51:35.068549 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:35.068550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:35.068560 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:35.068590 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:35.068903 (+ 313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55700: BlockingRecv error: recv got EOF from 127.0.0.1:55700 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260809 18:51:35.072768 18179 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:35.072034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55714 (local address 127.12.202.253:44281)
0809 18:51:35.072066 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:35.072067 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:35.072290 (+ 223us) server_negotiation.cc:407] Connection header received
0809 18:51:35.072407 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:35.072408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:35.072418 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:35.072445 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:35.072732 (+ 287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55714: BlockingRecv error: recv got EOF from 127.0.0.1:55714 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260809 18:51:35.078648 18179 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:35.077861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55716 (local address 127.12.202.253:44281)
0809 18:51:35.077894 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:35.077897 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:35.078118 (+ 221us) server_negotiation.cc:407] Connection header received
0809 18:51:35.078211 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:35.078212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:35.078223 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:35.078251 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:35.078609 (+ 358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55716: BlockingRecv error: recv got EOF from 127.0.0.1:55716 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260809 18:51:35.088738 18179 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:35.087805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55730 (local address 127.12.202.253:44281)
0809 18:51:35.087840 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:35.087841 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:35.088074 (+ 233us) server_negotiation.cc:407] Connection header received
0809 18:51:35.088170 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:35.088171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:35.088182 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:35.088210 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:35.088696 (+ 486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55730: BlockingRecv error: recv got EOF from 127.0.0.1:55730 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260809 18:51:35.106787 18179 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:35.105911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55738 (local address 127.12.202.253:44281)
0809 18:51:35.105950 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:35.105952 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:35.106209 (+ 257us) server_negotiation.cc:407] Connection header received
0809 18:51:35.106308 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:35.106309 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:35.106320 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:35.106350 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:35.106738 (+ 388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55738: BlockingRecv error: recv got EOF from 127.0.0.1:55738 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 18:51:35.140966 18179 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:35.140179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55748 (local address 127.12.202.253:44281)
0809 18:51:35.140234 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:35.140237 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:35.140421 (+ 184us) server_negotiation.cc:407] Connection header received
0809 18:51:35.140480 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:35.140481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:35.140495 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:35.140566 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:35.140904 (+ 338us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55748: BlockingRecv error: recv got EOF from 127.0.0.1:55748 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260809 18:51:35.207000 18179 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:35.206120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55760 (local address 127.12.202.253:44281)
0809 18:51:35.206220 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:35.206222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:35.206337 (+ 115us) server_negotiation.cc:407] Connection header received
0809 18:51:35.206448 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:35.206449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:35.206461 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:35.206534 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:35.206921 (+ 387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55760: BlockingRecv error: recv got EOF from 127.0.0.1:55760 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260809 18:51:35.337020 18179 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:35.336178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55762 (local address 127.12.202.253:44281)
0809 18:51:35.336246 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:35.336248 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:35.336365 (+ 117us) server_negotiation.cc:407] Connection header received
0809 18:51:35.336461 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:35.336461 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:35.336472 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:35.336585 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:35.336945 (+ 360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55762: BlockingRecv error: recv got EOF from 127.0.0.1:55762 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260809 18:51:35.594959 18179 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 18:51:35.594265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55766 (local address 127.12.202.253:44281)
0809 18:51:35.594347 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:35.594349 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:35.594402 (+ 53us) server_negotiation.cc:407] Connection header received
0809 18:51:35.594463 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:35.594464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:35.594475 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:35.594537 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 18:51:35.594892 (+ 355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55766: BlockingRecv error: recv got EOF from 127.0.0.1:55766 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:51:35.933928 18333 catalog_manager.cc:1259] Loaded cluster ID: bfbce3cac0264f2f873ed54974e4d017
I20260809 18:51:35.934008 18333 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5: loading cluster ID for follower catalog manager: success
I20260809 18:51:35.934844 18333 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5: acquiring CA information for follower catalog manager: success
I20260809 18:51:35.935189 18333 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 465be9c9ddaa49998955dfc873a3c6e5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 18:51:36.023432 18402 catalog_manager.cc:1259] Loaded cluster ID: bfbce3cac0264f2f873ed54974e4d017
I20260809 18:51:36.023540 18402 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945: loading cluster ID for follower catalog manager: success
I20260809 18:51:36.024447 18402 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945: acquiring CA information for follower catalog manager: success
I20260809 18:51:36.024778 18402 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2485e70c95d94286a0378365ce3db945: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 18:51:36.110980 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:36.108203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55768 (local address 127.12.202.253:44281)
0809 18:51:36.108368 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:36.108370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:36.108386 (+ 16us) server_negotiation.cc:407] Connection header received
0809 18:51:36.108508 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:36.108509 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:36.108576 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:36.108679 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:36.108858 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:36.109341 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:36.110123 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:36.110324 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:36.110398 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:36.110602 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:36.110712 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:36.110810 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:36.110848 (+ 38us) server_negotiation.cc:299] Negotiation successful
0809 18:51:36.110870 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":63,"threads_started":1}
I20260809 18:51:36.115211 18530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:36.112958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55522 (local address 127.12.202.252:40329)
0809 18:51:36.113089 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:36.113091 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:36.113099 (+ 8us) server_negotiation.cc:407] Connection header received
0809 18:51:36.113135 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:36.113136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:36.113171 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:36.113277 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:36.113376 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:36.113869 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:36.114573 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:36.114770 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:36.114826 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:36.114950 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:36.115046 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:36.115095 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:36.115132 (+ 37us) server_negotiation.cc:299] Negotiation successful
0809 18:51:36.115147 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":77,"threads_started":1}
I20260809 18:51:36.119801 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:36.117196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55778 (local address 127.12.202.253:44281)
0809 18:51:36.117235 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:36.117237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:36.117248 (+ 11us) server_negotiation.cc:407] Connection header received
0809 18:51:36.117344 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:36.117346 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:36.117355 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:36.117395 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:36.117537 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:36.118306 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:36.119057 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:36.119315 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:36.119375 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:36.119531 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:36.119564 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:36.119611 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:36.119693 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 18:51:36.119716 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 18:51:36.120112 18530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:36.117068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55524 (local address 127.12.202.252:40329)
0809 18:51:36.117129 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:36.117131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:36.117276 (+ 145us) server_negotiation.cc:407] Connection header received
0809 18:51:36.117300 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:36.117301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:36.117310 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:36.117356 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:36.117521 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:36.118288 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:36.119269 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:36.119569 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:36.119628 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:36.119789 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:36.119817 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:36.119855 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:36.120022 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 18:51:36.120045 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 18:51:36.120436 18541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 18:51:36.116956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35710 (local address 127.12.202.254:32785)
0809 18:51:36.117062 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 18:51:36.117064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 18:51:36.117211 (+ 147us) server_negotiation.cc:407] Connection header received
0809 18:51:36.117328 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 18:51:36.117330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 18:51:36.117384 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 18:51:36.117463 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 18:51:36.117598 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:36.118136 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:36.119231 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 18:51:36.119546 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 18:51:36.119613 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 18:51:36.119809 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 18:51:36.119919 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 18:51:36.119956 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0809 18:51:36.120085 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 18:51:36.120357 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":50,"threads_started":1}
I20260809 18:51:36.122097 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 17940
I20260809 18:51:36.136745 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 18062
I20260809 18:51:36.148113 13099 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskr0scnw/build/release/bin/kudu with pid 18182
2026-08-09T18:51:36Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3038 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6134 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (311479 ms total)
[ PASSED ] 54 tests.
[ FAILED ] 2 tests, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
[ FAILED ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
2 FAILED TESTS